-- Logs begin at Thu 2022-09-01 08:21:01 UTC, end at Thu 2022-09-01 09:39:45 UTC. -- Sep 01 09:01:41.290818 dv-cinder-820027-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 09:01:41.298087 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 09:01:41 2022] *** Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: nodename: dv-cinder-820027-23-iscsi Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: machine: x86_64 Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: clock source: unix Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: pcre jit disabled Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: detected number of CPU cores: 4 Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: current working directory: / Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: detected binary path: /usr/bin/uwsgi-core Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: your processes number limit is 47680 Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: your memory page size is 4096 bytes Sep 01 09:01:41.301250 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: detected max file descriptor number: 2048 Sep 01 09:01:41.302759 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: lock engine: pthread robust mutexes Sep 01 09:01:41.302759 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: thunder lock: enabled Sep 01 09:01:41.302759 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 09:01:41.302759 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 09:01:41.341753 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: Python main interpreter initialized at 0x55c218f709c0 Sep 01 09:01:41.341753 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: python threads support enabled Sep 01 09:01:41.341753 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: your server socket listen backlog is limited to 100 connections Sep 01 09:01:41.341753 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: your mercy for graceful operations on workers is 90 seconds Sep 01 09:01:41.342140 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 09:01:41.342225 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: *** Operational MODE: preforking *** Sep 01 09:01:41.342432 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: *** uWSGI is running in multiple interpreter mode *** Sep 01 09:01:41.342432 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: spawned uWSGI master process (pid: 106060) Sep 01 09:01:41.342642 dv-cinder-820027-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 09:01:41.344180 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: spawned uWSGI worker 1 (pid: 106061, cores: 1) Sep 01 09:01:41.344180 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: spawned uWSGI worker 2 (pid: 106062, cores: 1) Sep 01 09:01:41.344180 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 09:01:42.006987 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 09:01:42.007833 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 09:01:43.101234 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:01:43.101234 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: from cryptography.utils import int_from_bytes Sep 01 09:01:43.101826 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:01:43.101826 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: from cryptography.utils import int_from_bytes Sep 01 09:01:43.104608 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:01:43.104608 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: from cryptography.utils import int_from_bytes Sep 01 09:01:43.105064 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:01:43.105064 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: from cryptography.utils import int_from_bytes Sep 01 09:01:45.594349 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 09:01:45.594839 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 09:01:45.595274 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 09:01:45.595631 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 09:01:45.595770 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 09:01:45.596139 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 09:01:45.596225 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 09:01:45.596316 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.596552 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 09:01:45.596654 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.596866 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.596954 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 09:01:45.597160 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 09:01:45.597259 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.597497 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.597588 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.597802 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.597889 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.598117 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.598212 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.598431 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.598524 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.598758 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.598867 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.599016 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.599125 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.599368 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.599455 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.599691 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-23-iscsi {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.599790 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.600009 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.600095 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.600310 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.600402 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.600613 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.600700 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.600927 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.601020 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-23-iscsi {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.601227 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.601322 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.601544 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.601637 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.601844 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.601937 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.602170 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.602344 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.602512 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.602933 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.603040 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.603136 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.603208 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.603374 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.603600 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.603706 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.603917 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.604003 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.604228 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.604333 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.604540 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.604633 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.604877 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.604975 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.605193 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.605285 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.605496 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.605606 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.605816 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.605920 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-23-iscsi {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.606127 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.606241 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.606452 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.606539 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.606763 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.606850 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.607183 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-23-iscsi {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.607272 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.607498 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.607591 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.607806 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.607907 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.608119 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.608212 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.608437 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.608523 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.608743 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.608831 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.609097 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.609184 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.609480 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.609607 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.609815 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.609947 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.610130 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.610269 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.610460 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.610573 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.610780 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.610883 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.611119 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.611208 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.611442 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.611540 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.611747 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.611848 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.612057 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.612143 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.612317 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.612410 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.612622 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.612713 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.612939 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.613025 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.613254 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.613346 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.613504 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.613590 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.613805 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.613901 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.614051 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.614137 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.614365 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.614462 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.614679 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.614776 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.614983 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.615081 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.615261 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.615360 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.615585 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.615670 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.615890 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.615985 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.616193 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.616283 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.616494 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.616581 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.616794 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.616881 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.617097 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.617189 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.617402 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.617486 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.617710 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.617796 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.618017 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.618102 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.618317 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.618401 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.618631 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.618718 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.618946 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.619030 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.619285 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.619384 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.619592 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.619679 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.619913 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.619997 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.620227 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.620321 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.620532 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.620618 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.620846 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.620938 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.621162 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.621255 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.621469 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.621569 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.621772 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.621864 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.622075 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.622171 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.622392 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.622479 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.622698 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.622788 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623006 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623124 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623278 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623363 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623577 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623662 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623879 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.623966 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.624195 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.624295 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.624495 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.624582 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.624887 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.624979 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.625204 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.625291 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.625527 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.625648 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.625837 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.625930 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.626139 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.626230 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.626444 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.626530 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.626745 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.626830 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.627047 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.627204 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.627396 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.627521 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.627701 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.627832 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.628006 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.628139 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.628309 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.628454 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.628610 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.628765 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.628927 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.629073 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.629243 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.629384 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.629546 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.629692 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.629848 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.630000 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.630152 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.630322 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.630455 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.630644 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.630771 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.630953 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.631073 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.631288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.631386 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.631595 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.631708 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.631903 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.631997 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.632224 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.632318 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.632532 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.632627 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.632838 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.632930 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.633161 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.633252 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.633467 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.633552 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.633766 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.633852 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.634069 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.634168 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.634377 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.634503 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.634681 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.634774 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.634983 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.635070 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.635305 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.635394 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.635606 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.635709 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.635906 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.635996 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.636207 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.636336 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.636506 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.636602 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.636807 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.636894 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.637109 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.637193 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.637415 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.637509 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.637721 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.637808 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.638023 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.638108 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.638588 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.638677 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.638887 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.638979 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.639223 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.639312 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.639549 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.639635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.639859 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.639955 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.640167 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.640253 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.641027 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.641105 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.641364 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.641484 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:01:45.641684 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.641771 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.642002 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.642090 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.642313 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.642407 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.642624 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.642720 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.642947 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.643040 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.643281 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.643380 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.643591 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.643758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.643898 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.643984 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.644212 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.644298 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.644527 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.644626 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.644853 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.644940 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.645167 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.645263 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.645479 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.645578 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.645792 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.645920 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.646099 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.646186 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.646413 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.646507 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.646732 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.646825 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.647045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.647162 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.647383 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.647479 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.647695 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.647780 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.648016 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.648101 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.648344 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.648438 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.648664 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.648759 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.648979 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.649064 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.649290 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.649378 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.649599 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.649686 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.649908 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.649993 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.650247 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.650401 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.650555 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.650641 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.650863 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.650956 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.651209 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.651298 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.651518 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.651605 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.651838 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.651933 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.652148 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.652241 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.652457 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.652547 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.652765 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.652863 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.653073 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.653163 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.653381 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.653466 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.653698 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.653794 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.654012 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.654098 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.654323 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.654408 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.654632 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.654720 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.654939 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.655024 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.655276 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.655376 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.655584 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.655673 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.655889 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.656668 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.656806 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.656921 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.657112 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.657217 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.657427 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.657520 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.657744 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.657837 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.658058 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.658144 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.658359 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.658453 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.658664 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.658748 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.658977 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.659064 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.659311 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.659399 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.659629 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.659715 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.659932 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.660018 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.660241 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.660328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.660548 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.660641 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.660854 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.660941 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.661156 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.661247 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.661463 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.661556 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.661768 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.661867 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.662071 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.662164 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.662379 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.662472 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.662687 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.662771 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.662990 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.663185 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.663325 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.663427 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.663634 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.663728 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.663944 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.664030 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.664256 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.664358 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.664561 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.664645 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.664866 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.664957 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.665175 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.665262 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.665479 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.665564 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.665795 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.665882 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.666102 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.666188 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.666411 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.666497 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.666736 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.666820 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.667050 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.667171 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.667377 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.667511 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.667698 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.667794 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.668008 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.668100 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.668321 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.668407 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.668623 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.668721 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.668928 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.669015 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.669228 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.669314 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.669527 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.669622 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.669827 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.669919 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.670130 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.670216 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.670429 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.670523 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.670728 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.670814 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.671028 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.671133 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.671355 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.671443 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.671725 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.671871 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.672111 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.672256 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.672362 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.672570 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.672656 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.672874 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.672960 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.673178 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.673322 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.673480 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.673573 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.673819 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.673906 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.674123 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.674215 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.674428 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.674515 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.674733 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.674819 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.675078 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.675231 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.675410 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.675495 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.675717 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.675801 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.676030 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.676126 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.676338 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.676433 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.676641 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.676729 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.676949 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.677043 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.677254 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.677347 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.677568 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.677653 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.677879 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.677966 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.678194 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.678320 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.678499 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.678593 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.678816 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.678903 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.679138 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.679228 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.679462 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.679559 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.679763 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.679849 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.680074 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.680160 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.680384 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.680477 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.680707 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.680805 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.681014 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.681101 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.681328 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.681421 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.681636 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.681722 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.681945 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.682031 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.682247 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.682341 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.682551 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.682645 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.682856 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.682942 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.683182 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.683271 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.683499 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.683594 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.683805 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.683901 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.684117 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.684204 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.684421 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.684506 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.684737 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.684830 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.685042 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.685129 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.685353 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.685439 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.685655 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.685741 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.685965 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.686053 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.686274 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.686367 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.686596 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.686691 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.686901 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.687034 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.687772 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.688012 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.688110 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.688200 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.688442 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.688539 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.688756 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.688844 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.689075 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.689169 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.689385 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.689470 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.689688 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.689784 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.689996 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.690090 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.690311 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.690396 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.690617 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.690709 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.690924 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.691009 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.691258 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.691347 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.691573 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.691669 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.691879 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.691966 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.692180 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.692273 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.692481 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.692567 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.692788 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.692874 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.693098 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.693182 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.693402 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.693486 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.693707 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.693793 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.694022 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.694107 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.694319 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.694402 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.694620 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.694706 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.694937 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.695021 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.695268 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.695380 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.695569 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.695663 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.695868 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.695954 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.696167 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.696329 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.696524 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.696621 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.696797 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.696891 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.697097 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.697197 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.697402 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.697497 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.697715 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.697800 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.698021 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.698115 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.698333 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.698425 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.698640 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.698726 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.698947 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.699033 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.699293 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.699390 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.699603 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.699689 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.699910 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.700004 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.700215 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.700302 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.700521 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.700607 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.700825 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.700913 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.701132 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.701217 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.701441 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.701526 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.701747 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.701841 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.702056 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.702141 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.702359 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.702453 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.702657 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.702743 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.703546 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.703645 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.703865 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.703962 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.704259 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.704427 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.704569 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.704755 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.704886 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.705067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.705207 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.705385 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.705724 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.705817 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.706042 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.706129 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.706370 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.706459 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.706694 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.706789 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.707005 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.707093 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.707345 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.707453 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.707653 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.707739 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.707954 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.708040 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.708260 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.708358 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.708569 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.708654 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.708869 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.708955 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.709170 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.709265 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.709469 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.709555 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.709772 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.709857 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.710072 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.710159 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.710378 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.710502 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.710676 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.710778 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.710976 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.711076 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.711305 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.711412 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.711603 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.711699 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.711910 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.712005 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.712207 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.712303 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.712521 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.712616 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.712824 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.712921 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.713123 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.713219 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.713422 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.713532 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.713723 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.713824 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.714040 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.714126 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.714345 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.714440 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.714648 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.714732 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.714955 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.715041 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.715329 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.715430 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.715632 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.715718 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.715933 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.716019 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.716252 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.716348 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.716555 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.716689 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.716857 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.716943 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.717157 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.717244 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.717462 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.717558 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.717765 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.717851 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.718064 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.718151 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.718382 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.718530 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.718711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.718809 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.719017 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.719124 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.719346 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.719443 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.719644 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.719738 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.719948 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.720034 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.720247 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.720340 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.720555 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.720714 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.720858 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.720943 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.721156 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.721241 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.721453 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.721548 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.721758 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.721852 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.722061 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.722148 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.722357 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.722453 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.722659 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.722744 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.722955 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.723040 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.723291 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.723387 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.723589 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.723740 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.723888 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.723979 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.724186 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.724283 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.724489 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.724575 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.724792 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.724877 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.725089 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.725182 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.725391 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.725477 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.725697 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.725782 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.725996 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.726083 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.726293 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.726386 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.726596 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.726694 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.726893 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.726989 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.727212 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.727301 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.727520 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.727621 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.727829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.727915 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.728136 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.728231 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.728434 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.728527 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.728739 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.728834 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.729038 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.729125 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.729337 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.729442 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.729635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.729722 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.729938 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.730024 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.730235 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.730323 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.730534 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.730619 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.730831 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.730916 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.731145 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.731236 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.731447 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.731533 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.731750 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.731835 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.732052 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.732138 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.732348 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.732447 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.732648 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.732733 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.732945 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.733033 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.733267 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.733352 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.733566 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.733659 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.733870 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.733965 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.734232 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.734374 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.734628 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.734907 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.734996 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.735341 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.735452 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.735656 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.735810 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.735977 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.736122 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.736300 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.736437 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.736615 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.736744 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.736931 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.737060 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.737251 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.737372 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.737564 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.737686 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.737884 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.737992 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.738201 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.738286 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.738522 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.738914 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.738998 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.739077 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.739215 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.739296 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.739474 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.739575 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.739792 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.739880 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.740109 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.740195 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.740432 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.740525 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.740741 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.740828 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.741048 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.741142 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.741354 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.741449 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.741659 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.741747 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.741968 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.742061 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.742276 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.742363 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.742584 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.742670 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.742890 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.742984 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.743220 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.743310 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.743527 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.743613 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.743828 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.743914 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.744136 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.744232 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.744441 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.744527 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.744743 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.744828 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.745054 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.745140 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.745358 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.745452 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.745659 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.745754 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.745965 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.746058 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.746265 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.746352 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.746572 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.746665 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.746873 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.747008 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.747198 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.747327 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.747514 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.747651 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.747825 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.747919 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.748227 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.748331 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.748535 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.748630 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.748841 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.748928 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.749152 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.749244 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.749461 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.749556 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.750281 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.750394 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.750688 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.750774 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.750998 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.751094 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.751332 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.751420 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.751641 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.751762 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.751944 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.752083 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.752243 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.752402 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.752549 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.752721 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.752869 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.753033 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.753170 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.753342 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.753470 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.753657 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.753805 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.753988 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.754091 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.754298 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.754400 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.754607 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.754695 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.754914 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.755062 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.755267 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.755397 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.755578 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.755701 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.755905 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.756113 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.756328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.756415 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.756645 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.756739 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.756958 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.757094 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.757324 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.757435 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.757645 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.757785 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.757950 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.758046 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.758260 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.758347 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.758568 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.758663 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.758887 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.758973 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.759230 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.759324 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.759541 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.759641 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.759852 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.759947 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.760153 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.760262 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.760472 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.760632 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.760790 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.760878 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.761100 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.761186 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.761418 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.761513 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.761803 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.761896 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.762130 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.762216 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.762434 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.762528 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.762753 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.762847 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.763074 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.763469 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.763664 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.763775 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.763966 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.764092 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.764276 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.764418 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.764574 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.764746 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.764876 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.765056 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.765194 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.765980 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.766138 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.766300 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.766389 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.766609 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.766734 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.766919 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.767042 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.767271 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.767374 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.767646 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.767736 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.767966 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.768056 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.768263 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.768356 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.768581 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.768673 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.768891 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.768985 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.769197 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.769282 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.769512 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.769598 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.769812 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.769899 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.770129 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.770216 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.770433 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.770692 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.770786 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.771023 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.771168 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.771348 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.771623 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.771718 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.771973 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.772067 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.772288 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.772533 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.772619 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.772922 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.773009 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.773310 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.773450 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.773645 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.773948 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.774043 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.774271 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.774382 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.774585 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.774865 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.774960 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.775214 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.775350 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.775515 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.775819 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.775914 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.776120 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.776337 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.776423 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.776701 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.776792 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.777003 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.777105 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.777301 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.777448 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.777599 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.777784 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.777904 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.778112 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.778220 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.778438 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.778524 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.778771 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.778870 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.779087 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.779234 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.779417 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.779504 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.779714 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.779812 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.780011 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.780099 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.780321 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.780407 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.780629 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.780728 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.780980 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.781097 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.781391 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.781526 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.781719 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.781955 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.782043 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.782334 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.782427 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.782648 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.782902 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.782990 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.783283 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.783419 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.783595 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.783874 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.783975 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.784198 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.784309 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.784508 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.784755 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.784846 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.785116 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.785227 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.785634 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.785722 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.785962 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.786180 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.786328 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.786497 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.786591 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.786833 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.786926 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.787167 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.787268 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.787495 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.787589 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.787804 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.787891 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.788117 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.788212 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.788422 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.788556 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.788729 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.788863 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.789053 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.789139 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.789368 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.789453 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.789684 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.789778 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.789998 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.790085 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.790317 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.790402 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.790629 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.790839 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.790928 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.791263 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.791355 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.791616 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.791929 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.792084 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.792235 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.792546 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.792632 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.792857 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.793071 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.793161 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.793460 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.793546 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.793766 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.793940 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.794073 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.794382 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.794468 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.794689 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.794880 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.794995 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.795328 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.795418 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.795639 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.795771 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.795958 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.796091 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.796286 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.796419 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.796633 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.796783 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.796941 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.797081 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.797249 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.797483 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.797577 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.797831 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.798063 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.798206 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.798373 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.798468 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.798700 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.798787 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.799021 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.799152 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.799363 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.799451 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.799676 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.799849 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.799988 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.800279 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.800366 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.800595 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.800718 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.800893 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.801194 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.801281 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.801496 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.801683 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.801794 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.802110 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.802205 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.802415 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.802615 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.802701 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.803067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.803192 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.803361 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.803512 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.803886 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.803996 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.804227 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.804476 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.804576 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.804845 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.804985 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.805165 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.805311 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.805477 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.805645 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.805779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.805989 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.806095 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.806318 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.806406 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.806641 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.806745 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.806961 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.807050 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.807306 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.807395 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.807610 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.807836 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.807924 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.808159 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.808299 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.808499 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.808587 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.808799 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.808893 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.809106 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.809202 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.809406 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.809500 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.809727 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.809821 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.810030 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.810117 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.810330 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.810417 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.810631 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.810718 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.810937 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.811025 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.811260 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.811350 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.811562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.811648 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.811862 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.811951 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.812667 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.812777 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.813037 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.813194 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.813506 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.813601 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.813817 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.813905 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.814122 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.814355 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.814442 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.814708 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.814802 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.815033 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.815138 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.815386 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.815474 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.815706 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.815806 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.816010 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.816097 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.816310 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.816398 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.816623 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.816709 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.816929 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.817023 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.817237 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.817329 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.817543 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.817636 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.817848 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.817955 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.818157 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.818243 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.818466 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.818555 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.818781 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.819007 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.819095 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.819364 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.819453 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.819681 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.819774 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.820011 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.820098 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.820337 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.820432 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.820640 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.820734 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.820943 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.821030 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.821246 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.821339 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.821557 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.821655 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.821864 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.821950 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.822169 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.822253 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.822474 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.822567 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.822779 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.822874 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.823083 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.823188 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.823412 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.823509 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.823717 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.823804 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.824022 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.824107 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.824324 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.824413 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.824627 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.824720 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.824932 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.825020 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.825236 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.825325 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.825541 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.825629 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.825846 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.825933 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.826157 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.826245 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.826481 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.826568 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.826792 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.826890 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.827147 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.827238 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.827442 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.827527 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.827752 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.827892 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.828627 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.828725 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.828986 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.829071 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.829365 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.829526 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.829674 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.829864 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.829989 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.830188 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.830315 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.830525 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.830619 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.830861 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.830955 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.831205 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.831344 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.831517 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.831654 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.831825 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.831972 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.832150 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.832289 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.832466 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.832596 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.832779 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.832914 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.833092 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.833231 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.833405 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.833535 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.833717 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.833854 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.834027 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.834161 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.834337 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.834485 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.834651 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.834819 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.834964 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.835162 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.835304 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.835483 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.835618 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.835784 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.835929 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.836086 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.836239 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.836384 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.836551 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.836688 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.836868 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.837002 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.837211 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.837298 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.837534 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.837629 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.837855 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.837942 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.838173 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.838259 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.838468 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.838562 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.838767 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.838857 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.839064 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.839183 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.839388 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.839476 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.839693 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.839782 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.839991 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.840077 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.840287 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.840378 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.840586 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.840689 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.840882 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.840969 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.841178 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.841346 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.841476 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.841666 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.841777 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.841989 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.842085 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.842315 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.842402 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.842628 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.842722 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.842922 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.843016 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.843241 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.843333 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.843633 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.843721 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.844060 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.844160 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.844369 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.844457 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.844689 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.844776 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.844996 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.845084 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.845311 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.845409 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.845615 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.845711 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.845933 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.846020 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.846247 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.846333 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.846555 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.846651 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.846859 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.846947 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.847211 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.847300 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.847518 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.847626 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.847824 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.847911 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.848129 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.848220 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.848434 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.848534 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.848736 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.848825 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.849039 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.849125 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.849340 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.849465 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.849653 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.849742 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.849960 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.850045 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.850262 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.850355 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.850566 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.850654 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.850870 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.850955 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.851202 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.851292 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.851509 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.851594 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.851809 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.851911 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.852120 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.852214 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.852422 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.852510 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.852725 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.852820 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.853027 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.853121 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.853330 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.853416 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.853630 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.853789 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.853939 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.854058 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.854243 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.854347 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.854552 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.854667 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.854864 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.854960 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.855207 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.855301 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.855531 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.855620 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.855835 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.855924 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.856154 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.856240 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.856473 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.856561 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.856786 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.856872 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.857096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.857182 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.857429 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.857531 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.857738 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.857826 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.858053 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.858202 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.858358 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.858453 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.858660 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.858747 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.858899 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 09:01:45.859003 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.859532 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.859880 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.860211 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.860522 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.860853 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.861173 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.861496 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.861815 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.862128 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.862460 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.862771 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.863084 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.863418 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.863732 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.864045 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.864362 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.864673 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.864984 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.865300 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.865619 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.865948 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.866276 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.866588 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.866916 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.867268 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.867623 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.867939 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.868282 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.868613 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.868932 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.869245 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.869554 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:01:45.869802 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 09:01:46.013557 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO dbcounter [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Registered counter for database nova_api Sep 01 09:01:46.024250 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO dbcounter [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Registered counter for database nova_api Sep 01 09:01:46.035270 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_db.sqlalchemy.engines [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.041786 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writer thread running {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.043681 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_db.sqlalchemy.engines [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.050312 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writer thread running {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.100858 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.context [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b35e4d9-fea5-4082-84bb-222d74bca9ee(cell1) {{(pid=106062) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 09:01:46.104654 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:01:46.105284 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:01:46.106837 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:01:46.107595 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:01:46.108036 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:01:46.110547 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:01:46.110664 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.context [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b35e4d9-fea5-4082-84bb-222d74bca9ee(cell1) {{(pid=106061) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 09:01:46.112544 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO dbcounter [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Registered counter for database nova_cell0 Sep 01 09:01:46.114408 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_concurrency.lockutils [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:01:46.114982 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_concurrency.lockutils [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:01:46.116517 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO dbcounter [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Registered counter for database nova_cell1 Sep 01 09:01:46.116622 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_concurrency.lockutils [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:01:46.117301 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_concurrency.lockutils [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:01:46.117751 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_concurrency.lockutils [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:01:46.119862 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_concurrency.lockutils [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:01:46.121860 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO dbcounter [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Registered counter for database nova_cell0 Sep 01 09:01:46.124134 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_db.sqlalchemy.engines [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.126964 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO dbcounter [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Registered counter for database nova_cell1 Sep 01 09:01:46.127604 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_db.sqlalchemy.engines [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.132598 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writer thread running {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.135255 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_db.sqlalchemy.engines [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.135602 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writer thread running {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.136596 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_db.sqlalchemy.engines [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.143402 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writer thread running {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.144875 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writer thread running {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.285075 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO dbcounter [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Registered counter for database nova_cell0 Sep 01 09:01:46.289797 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO dbcounter [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Registered counter for database nova_cell0 Sep 01 09:01:46.294016 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_db.sqlalchemy.engines [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.298887 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG oslo_db.sqlalchemy.engines [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:01:46.299318 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writer thread running {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.303656 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writer thread running {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:01:46.724194 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: WARNING keystonemiddleware.auth_token [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:01:46.731470 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: WARNING keystonemiddleware.auth_token [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:01:46.741670 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: WARNING keystonemiddleware.auth_token [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:01:46.748926 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: WARNING keystonemiddleware.auth_token [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:01:47.072706 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: WARNING keystonemiddleware.auth_token [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:01:47.079469 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: WARNING keystonemiddleware.auth_token [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:01:47.084713 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c218f709c0 pid: 106062 (default app) Sep 01 09:01:47.086757 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:01:47.088030 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 Sep 01 09:01:47.088442 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Sep 1 09:01:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:01:47.089870 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: WARNING keystonemiddleware.auth_token [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:01:47.096432 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: WARNING keystonemiddleware.auth_token [None req-b561ac05-02d2-4bde-8b4b-65d9e944bd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:01:47.101712 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c218f709c0 pid: 106061 (default app) Sep 01 09:03:07.166333 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:07.167596 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Sep 01 09:03:07.168118 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:07.180502 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writing DB stats nova_api:SELECT=3 {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:07.181436 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writing DB stats nova_cell0:SELECT=3 {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:07.182544 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writing DB stats nova_cell1:SELECT=3 {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:07.183706 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:08.054244 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-119ed5e3-8d56-4f56-8ba9-b113375abb50 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:08.086973 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-119ed5e3-8d56-4f56-8ba9-b113375abb50 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911890 Sep 01 09:03:08.087877 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 09:03:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:10.449967 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:10.450888 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-eccc621a-d7f1-40cf-b8d5-91d1f1b98898 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 01 09:03:10.451487 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:10.915800 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-fe877ebc-2fce-4121-9049-b7b466f264e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:11.029329 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-fe877ebc-2fce-4121-9049-b7b466f264e3 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.570714 Sep 01 09:03:11.030789 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:11.044886 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_api:SELECT=3 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:11.045992 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_cell0:SELECT=3 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:11.046746 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_cell1:SELECT=3 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:11.047829 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:11.260195 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-c731069f-f5e3-442b-b766-025a62eb676c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:11.389368 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-c731069f-f5e3-442b-b766-025a62eb676c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.349568 Sep 01 09:03:11.389960 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 09:03:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:13.749467 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-fe877ebc-2fce-4121-9049-b7b466f264e3 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:13.750848 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-fe877ebc-2fce-4121-9049-b7b466f264e3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Sep 01 09:03:13.751666 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:14.412162 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-9be3701d-d943-4b7e-a91b-2ab25040d2b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "disk": 5, "ram": 512}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:14.531063 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-9be3701d-d943-4b7e-a91b-2ab25040d2b6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.772815 Sep 01 09:03:14.531762 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:14.544683 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-745cc1b5-aa85-4d6b-9492-052aa7408e8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:14.671010 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-745cc1b5-aa85-4d6b-9492-052aa7408e8a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129743 Sep 01 09:03:14.680032 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 09:03:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:17.051288 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-9be3701d-d943-4b7e-a91b-2ab25040d2b6 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:17.052351 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-9be3701d-d943-4b7e-a91b-2ab25040d2b6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 01 09:03:17.052762 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:17.449245 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-8882bfca-0371-47ab-8346-7cabf70a0277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "name": "ds1G", "ram": 1024}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:17.518217 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-8882bfca-0371-47ab-8346-7cabf70a0277 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458837 Sep 01 09:03:17.519130 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:17.531283 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-6230aca8-18c3-4176-8313-b65033e66140 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:17.625200 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-6230aca8-18c3-4176-8313-b65033e66140 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097614 Sep 01 09:03:17.626136 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 09:03:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:20.037215 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-8882bfca-0371-47ab-8346-7cabf70a0277 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:20.038263 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-8882bfca-0371-47ab-8346-7cabf70a0277 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 01 09:03:20.038828 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:20.463002 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-5540ee91-a02b-4d13-98f2-e24bac4c4baf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "vcpus": 2, "id": "d3"}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:20.541928 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-5540ee91-a02b-4d13-98f2-e24bac4c4baf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496878 Sep 01 09:03:20.542479 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 09:03:20.556451 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-27f6de8f-840a-4ab2-8072-1caf6603c164 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:20.632391 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-27f6de8f-840a-4ab2-8072-1caf6603c164 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080575 Sep 01 09:03:20.633334 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 09:03:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:03:23.006201 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-5540ee91-a02b-4d13-98f2-e24bac4c4baf admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:23.007250 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-5540ee91-a02b-4d13-98f2-e24bac4c4baf admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 01 09:03:23.007647 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:23.430689 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-8b4831b3-fe25-45a3-8f85-d759a26eba87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:23.517181 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-8b4831b3-fe25-45a3-8f85-d759a26eba87 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503067 Sep 01 09:03:23.518284 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 09:03:23.530699 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-d05e9497-d856-4798-a34d-640a651905d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:23.624881 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-d05e9497-d856-4798-a34d-640a651905d7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097997 Sep 01 09:03:23.629139 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Thu Sep 1 09:03:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:26.035909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-8b4831b3-fe25-45a3-8f85-d759a26eba87 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:26.036931 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-8b4831b3-fe25-45a3-8f85-d759a26eba87 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Sep 01 09:03:26.037339 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:03:26.471210 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-e198f4ad-939b-4f57-b18b-4f60c6b306b7 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:26.495948 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-e198f4ad-939b-4f57-b18b-4f60c6b306b7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452367 Sep 01 09:03:26.496629 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 09:03:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:03:28.942333 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-8b4831b3-fe25-45a3-8f85-d759a26eba87 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:28.943652 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-8b4831b3-fe25-45a3-8f85-d759a26eba87 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002547 Sep 01 09:03:28.944116 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:29.377523 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-1fe9e555-ef0d-47ac-a35e-467a286beb31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "ram": 512}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:29.455786 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-1fe9e555-ef0d-47ac-a35e-467a286beb31 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.504471 Sep 01 09:03:29.456282 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:29.468264 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-7a512b52-da54-4684-bfb3-07b2c448b256 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:29.546184 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-7a512b52-da54-4684-bfb3-07b2c448b256 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081552 Sep 01 09:03:29.546764 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 09:03:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:31.881686 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-1fe9e555-ef0d-47ac-a35e-467a286beb31 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:31.882695 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-1fe9e555-ef0d-47ac-a35e-467a286beb31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 01 09:03:31.883093 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:32.256881 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-27b239ca-9844-44c3-b720-757968301deb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:32.340992 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-27b239ca-9844-44c3-b720-757968301deb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451670 Sep 01 09:03:32.341588 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:32.353943 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-fb474444-9fb9-47b9-a085-8ba5e6de2d9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:32.452816 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-fb474444-9fb9-47b9-a085-8ba5e6de2d9f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102438 Sep 01 09:03:32.453306 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 09:03:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:34.799552 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-27b239ca-9844-44c3-b720-757968301deb admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:34.801873 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-27b239ca-9844-44c3-b720-757968301deb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002785 Sep 01 09:03:34.802282 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:35.254511 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-4162fd32-f00f-461e-a70e-0a2e139f8984 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:35.332257 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-4162fd32-f00f-461e-a70e-0a2e139f8984 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.523525 Sep 01 09:03:35.333570 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:35.346017 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-90bb35ed-6580-41b6-a383-bbf41085c62d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:35.426681 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-90bb35ed-6580-41b6-a383-bbf41085c62d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084355 Sep 01 09:03:35.427546 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 09:03:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:03:37.915880 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-4162fd32-f00f-461e-a70e-0a2e139f8984 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:37.917048 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-4162fd32-f00f-461e-a70e-0a2e139f8984 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 01 09:03:37.917638 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:38.362340 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-558369f2-4261-4d2b-8d28-a0b521bca13d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "disk": 80, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:38.371663 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:38.468233 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-558369f2-4261-4d2b-8d28-a0b521bca13d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.544447 Sep 01 09:03:38.468785 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:38.480919 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-b5b00182-c30f-4e9e-8f61-9a3accd8b081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:38.560400 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-b5b00182-c30f-4e9e-8f61-9a3accd8b081 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083114 Sep 01 09:03:38.563446 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 09:03:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:03:40.972012 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-558369f2-4261-4d2b-8d28-a0b521bca13d admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:03:40.973650 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-558369f2-4261-4d2b-8d28-a0b521bca13d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 01 09:03:40.974051 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:03:41.518866 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-56b7b319-02b7-402b-bbdb-5cd6304e7175 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "disk": 160, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:41.525899 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:42.171371 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-56b7b319-02b7-402b-bbdb-5cd6304e7175 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.191139 Sep 01 09:03:42.171929 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Thu Sep 1 09:03:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:03:42.188774 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-d0e6d968-ec81-44ef-a1a9-1e6c6d7da678 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:03:42.273364 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-d0e6d968-ec81-44ef-a1a9-1e6c6d7da678 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092909 Sep 01 09:03:42.286302 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Thu Sep 1 09:03:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:04:01.166796 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-56b7b319-02b7-402b-bbdb-5cd6304e7175 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:01.167796 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-56b7b319-02b7-402b-bbdb-5cd6304e7175 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 01 09:04:01.168197 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:04:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:01.565398 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-af44dffc-272d-4faf-a6da-b7eaa305fe60 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:01.585951 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-af44dffc-272d-4faf-a6da-b7eaa305fe60 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411683 Sep 01 09:04:01.586487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 09:04:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:04:02.655777 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-56b7b319-02b7-402b-bbdb-5cd6304e7175 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:02.656779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-56b7b319-02b7-402b-bbdb-5cd6304e7175 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 01 09:04:02.657175 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:03.179181 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5c71a5b3-9f54-4fdc-8b2f-a43ba9de88e5 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:03.184733 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.wsgi [None req-5c71a5b3-9f54-4fdc-8b2f-a43ba9de88e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5c71a5b3-9f54-4fdc-8b2f-a43ba9de88e5 admin admin] Request method failure captured: Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Accept: application/json Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Accept-Encoding: gzip, deflate Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Connection: keep-alive Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Content-Length: 0 Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Host: 10.222.0.46 Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Openstack-Api-Version: compute 2.90 Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Openstack-System-Scope: None Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: User-Agent: python-novaclient Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Auth-Token: gAAAAABjEHWCLWA8ihxT7A5BwoTvn1EB_dQG4gAO_H9hWqcAe0M1EW54giLWcLLY1_vwtCj5w1fYO9CDNCWaNnYIyehlMBq8ObwxZz_M2HTITjrBW4kSk-FZa7ZwwCtnbWLGcJ2DSRIvvzjxII-QdGUIlhJN0to0wj2u1VUSZRB-olb4AHtC9v4 Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Domain-Id: None Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Domain-Name: None Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Identity-Status: Confirmed Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Is-Admin-Project: True Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Domain-Id: default Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Domain-Name: Default Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Name: admin Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Role: admin,reader,member Sep 01 09:04:03.187965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Roles: admin,reader,member Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c919d0d1fdc41adb58cac59aa4513ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c919d0d1fdc41adb58cac59aa4513ea"}]}] Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant: admin Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant-Name: admin Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User: admin Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Domain-Id: default Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Domain-Name: Default Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Id: 78b783de521c4bc3ade218e12aef00c7 Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Name: admin Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: method: > Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: exception: Flavor 42 could not be found. Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: action_args: {'id': '42'} Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:04:03.189688 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:03.190829 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.192487 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5c71a5b3-9f54-4fdc-8b2f-a43ba9de88e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:04:03.193994 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-5c71a5b3-9f54-4fdc-8b2f-a43ba9de88e5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390391 Sep 01 09:04:03.193994 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 09:04:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 09:04:03.199428 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-d0c7bfa0-1543-4d22-9423-4d2c40da93a9 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:03.222734 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-d0c7bfa0-1543-4d22-9423-4d2c40da93a9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027214 Sep 01 09:04:03.224062 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 09:04:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:04:03.233614 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-3aa37f16-2cb8-40f4-b320-cddf1b3801a3 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:03.256361 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-3aa37f16-2cb8-40f4-b320-cddf1b3801a3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026371 Sep 01 09:04:03.256897 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 09:04:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:04:03.266649 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-c44790bd-2dfe-4955-8467-f129457b718b admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:03.273065 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.wsgi [None req-c44790bd-2dfe-4955-8467-f129457b718b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-c44790bd-2dfe-4955-8467-f129457b718b admin admin] Request method failure captured: Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Accept: application/json Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Accept-Encoding: gzip, deflate Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Connection: keep-alive Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Content-Length: 0 Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Host: 10.222.0.46 Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Openstack-Api-Version: compute 2.90 Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Openstack-System-Scope: None Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: User-Agent: python-novaclient Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Auth-Token: gAAAAABjEHWCLWA8ihxT7A5BwoTvn1EB_dQG4gAO_H9hWqcAe0M1EW54giLWcLLY1_vwtCj5w1fYO9CDNCWaNnYIyehlMBq8ObwxZz_M2HTITjrBW4kSk-FZa7ZwwCtnbWLGcJ2DSRIvvzjxII-QdGUIlhJN0to0wj2u1VUSZRB-olb4AHtC9v4 Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Domain-Id: None Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Domain-Name: None Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Identity-Status: Confirmed Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Is-Admin-Project: True Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Domain-Id: default Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Domain-Name: Default Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Name: admin Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Role: admin,reader,member Sep 01 09:04:03.276394 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Roles: admin,reader,member Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c919d0d1fdc41adb58cac59aa4513ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c919d0d1fdc41adb58cac59aa4513ea"}]}] Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant: admin Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant-Name: admin Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User: admin Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Domain-Id: default Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Domain-Name: Default Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Id: 78b783de521c4bc3ade218e12aef00c7 Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Name: admin Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: method: > Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: exception: Flavor 42 could not be found. Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: action_args: {'id': '42'} Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:04:03.282562 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:03.283525 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:03.284612 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-c44790bd-2dfe-4955-8467-f129457b718b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:04:03.285665 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-c44790bd-2dfe-4955-8467-f129457b718b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015026 Sep 01 09:04:03.285665 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 09:04:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 09:04:04.231893 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-3aa37f16-2cb8-40f4-b320-cddf1b3801a3 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:04.232915 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-3aa37f16-2cb8-40f4-b320-cddf1b3801a3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 01 09:04:04.233309 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:04.763617 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-42aa4179-fae0-472e-a343-548157004360 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:04.768947 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.wsgi [None req-42aa4179-fae0-472e-a343-548157004360 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-42aa4179-fae0-472e-a343-548157004360 admin admin] Request method failure captured: Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Accept: application/json Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Accept-Encoding: gzip, deflate Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Connection: keep-alive Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Content-Length: 0 Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Host: 10.222.0.46 Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Openstack-Api-Version: compute 2.90 Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Openstack-System-Scope: None Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: User-Agent: python-novaclient Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Auth-Token: gAAAAABjEHWE45-WeNJxLHUYTrSGcSJ2h1gGNcgsKu8_u9W9TABQYZK6U4drrQXM0Q_s4bch1oboJ3imzDYLhfAoXJ21Vy5_QUk_I_5fb3A5PIAICRLIdWOH8jqz9zYfZYWfRs5lLLnw3Mry51KxbpDCgoEWKtKAYYnlsblf4Q9KaXW3ERjANGc Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Domain-Id: None Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Domain-Name: None Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Identity-Status: Confirmed Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Is-Admin-Project: True Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Domain-Id: default Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Domain-Name: Default Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Name: admin Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Role: admin,reader,member Sep 01 09:04:04.771529 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Roles: admin,reader,member Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c919d0d1fdc41adb58cac59aa4513ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c919d0d1fdc41adb58cac59aa4513ea"}]}] Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant: admin Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant-Name: admin Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User: admin Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Domain-Id: default Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Domain-Name: Default Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Id: 78b783de521c4bc3ade218e12aef00c7 Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Name: admin Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: method: > Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: exception: Flavor 84 could not be found. Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: action_args: {'id': '84'} Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:04:04.773067 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:04.774045 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.775414 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-42aa4179-fae0-472e-a343-548157004360 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:04:04.776651 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-42aa4179-fae0-472e-a343-548157004360 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401908 Sep 01 09:04:04.776651 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 09:04:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 09:04:04.782494 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-fc29968b-362a-453c-8d49-d05b1ac7e12e admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:04.798112 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-fc29968b-362a-453c-8d49-d05b1ac7e12e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019121 Sep 01 09:04:04.798654 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 09:04:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:04:04.808504 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-c60cc41a-d4de-4444-a1a7-9bbc93c5e6fd admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:04.823858 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-c60cc41a-d4de-4444-a1a7-9bbc93c5e6fd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018846 Sep 01 09:04:04.824383 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 09:04:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:04:04.833778 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5087ed6c-5d32-4e92-b782-f53f74a8e97b admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:04.839257 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.wsgi [None req-5087ed6c-5d32-4e92-b782-f53f74a8e97b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5087ed6c-5d32-4e92-b782-f53f74a8e97b admin admin] Request method failure captured: Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Accept: application/json Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Accept-Encoding: gzip, deflate Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Connection: keep-alive Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Content-Length: 0 Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Host: 10.222.0.46 Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Openstack-Api-Version: compute 2.90 Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Openstack-System-Scope: None Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: User-Agent: python-novaclient Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Auth-Token: gAAAAABjEHWE45-WeNJxLHUYTrSGcSJ2h1gGNcgsKu8_u9W9TABQYZK6U4drrQXM0Q_s4bch1oboJ3imzDYLhfAoXJ21Vy5_QUk_I_5fb3A5PIAICRLIdWOH8jqz9zYfZYWfRs5lLLnw3Mry51KxbpDCgoEWKtKAYYnlsblf4Q9KaXW3ERjANGc Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Domain-Id: None Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Domain-Name: None Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Identity-Status: Confirmed Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Is-Admin-Project: True Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Domain-Id: default Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Domain-Name: Default Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Name: admin Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Role: admin,reader,member Sep 01 09:04:04.840758 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Roles: admin,reader,member Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c919d0d1fdc41adb58cac59aa4513ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c919d0d1fdc41adb58cac59aa4513ea"}]}] Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant: admin Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant-Name: admin Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User: admin Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Domain-Id: default Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Domain-Name: Default Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Id: 78b783de521c4bc3ade218e12aef00c7 Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Name: admin Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: method: > Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: exception: Flavor 84 could not be found. Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: action_args: {'id': '84'} Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:04:04.842114 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:04.842909 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:04.844096 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5087ed6c-5d32-4e92-b782-f53f74a8e97b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:04:04.845107 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-5087ed6c-5d32-4e92-b782-f53f74a8e97b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012206 Sep 01 09:04:04.845107 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Sep 1 09:04:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 09:04:05.797952 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-c60cc41a-d4de-4444-a1a7-9bbc93c5e6fd admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:05.798948 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-c60cc41a-d4de-4444-a1a7-9bbc93c5e6fd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 01 09:04:05.799368 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:06.316795 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5da222d7-4b3a-45d2-8207-2183162fd238 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:06.323279 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.wsgi [None req-5da222d7-4b3a-45d2-8207-2183162fd238 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5da222d7-4b3a-45d2-8207-2183162fd238 admin admin] Request method failure captured: Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Accept: application/json Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Accept-Encoding: gzip, deflate Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Connection: keep-alive Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Content-Length: 0 Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Host: 10.222.0.46 Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Openstack-Api-Version: compute 2.90 Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Openstack-System-Scope: None Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: User-Agent: python-novaclient Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Auth-Token: gAAAAABjEHWFpo9z0OhOpAqY66Y3C5ODFPxuxcaaY71zyYqgEdX3mxDasnGDjgVLr-IdGeqq2DJy5VZ45ZDhRQJlo1SonIeM4IjpI7kNDliXJXgOekAzDdEwJRBRwvQUKNr6s9sjJl3juVvaNRvTP-v_gsDqdKiH-LSEE5WheLiFAfut2zkJ9BQ Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Domain-Id: None Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Domain-Name: None Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Identity-Status: Confirmed Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Is-Admin-Project: True Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Domain-Id: default Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Domain-Name: Default Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Project-Name: admin Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Role: admin,reader,member Sep 01 09:04:06.326799 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Roles: admin,reader,member Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c919d0d1fdc41adb58cac59aa4513ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c919d0d1fdc41adb58cac59aa4513ea"}]}] Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant: admin Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-Tenant-Name: admin Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User: admin Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Domain-Id: default Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Domain-Name: Default Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Id: 78b783de521c4bc3ade218e12aef00c7 Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: X-User-Name: admin Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: method: > Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: exception: Flavor 451 could not be found. Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: action_args: {'id': '451'} Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:04:06.328328 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:06.329196 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.330288 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-5da222d7-4b3a-45d2-8207-2183162fd238 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:04:06.332255 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-5da222d7-4b3a-45d2-8207-2183162fd238 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390276 Sep 01 09:04:06.332255 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 09:04:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 09:04:06.335968 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-e5f794b5-8870-4f91-9419-33ae93b7f702 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:06.350938 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-e5f794b5-8870-4f91-9419-33ae93b7f702 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018703 Sep 01 09:04:06.351498 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 09:04:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:04:06.360812 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:06.376398 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019068 Sep 01 09:04:06.376936 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Sep 1 09:04:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:04:06.386859 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-703e9084-31ae-4d2f-875c-9e8bd29a241e admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:06.392236 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.wsgi [None req-703e9084-31ae-4d2f-875c-9e8bd29a241e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-703e9084-31ae-4d2f-875c-9e8bd29a241e admin admin] Request method failure captured: Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Accept: application/json Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Accept-Encoding: gzip, deflate Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Connection: keep-alive Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Content-Length: 0 Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Host: 10.222.0.46 Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Openstack-Api-Version: compute 2.90 Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Openstack-System-Scope: None Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: User-Agent: python-novaclient Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Auth-Token: gAAAAABjEHWFpo9z0OhOpAqY66Y3C5ODFPxuxcaaY71zyYqgEdX3mxDasnGDjgVLr-IdGeqq2DJy5VZ45ZDhRQJlo1SonIeM4IjpI7kNDliXJXgOekAzDdEwJRBRwvQUKNr6s9sjJl3juVvaNRvTP-v_gsDqdKiH-LSEE5WheLiFAfut2zkJ9BQ Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Domain-Id: None Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Domain-Name: None Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Identity-Status: Confirmed Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Is-Admin-Project: True Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Domain-Id: default Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Domain-Name: Default Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Project-Name: admin Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Role: admin,reader,member Sep 01 09:04:06.393711 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Roles: admin,reader,member Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c919d0d1fdc41adb58cac59aa4513ea", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c919d0d1fdc41adb58cac59aa4513ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c919d0d1fdc41adb58cac59aa4513ea"}]}] Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant: admin Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant-Id: 0c919d0d1fdc41adb58cac59aa4513ea Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-Tenant-Name: admin Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User: admin Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Domain-Id: default Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Domain-Name: Default Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Id: 78b783de521c4bc3ade218e12aef00c7 Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: X-User-Name: admin Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: method: > Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: exception: Flavor 451 could not be found. Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: action_args: {'id': '451'} Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:04:06.395635 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:06.396779 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: ERROR nova.api.openstack.wsgi Sep 01 09:04:06.398146 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-703e9084-31ae-4d2f-875c-9e8bd29a241e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:04:06.402470 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-703e9084-31ae-4d2f-875c-9e8bd29a241e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011714 Sep 01 09:04:06.402470 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 09:04:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 09:04:07.362598 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:07.363733 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Sep 01 09:04:07.364157 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:08.077495 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-f3f07f53-a970-4902-b8cb-ccf6d262c10f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:04:08.162421 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-f3f07f53-a970-4902-b8cb-ccf6d262c10f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.651918 Sep 01 09:04:08.162978 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 09:04:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:04:09.150747 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:09.151776 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 09:04:09.152172 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:09.676971 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-6e7bb914-b1ab-4428-8644-cb6002b9b0dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:04:09.765719 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-6e7bb914-b1ab-4428-8644-cb6002b9b0dc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.474496 Sep 01 09:04:09.766184 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 09:04:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:04:10.741039 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:10.742074 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002273 Sep 01 09:04:10.742466 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:11.256550 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-84344035-dbc6-4e32-a669-f9b5056dffc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:04:11.332181 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-84344035-dbc6-4e32-a669-f9b5056dffc6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.451859 Sep 01 09:04:11.332722 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 09:04:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:04:12.319394 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:12.320400 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 01 09:04:12.320789 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:12.837583 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-10fa5fb7-ee85-4803-af63-7b3ab16cf050 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:04:12.926348 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-10fa5fb7-ee85-4803-af63-7b3ab16cf050 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.469480 Sep 01 09:04:12.926903 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Sep 1 09:04:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:04:13.888649 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:13.889647 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 01 09:04:13.890036 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:04:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:04:14.405211 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-7e411315-ef97-4cc1-863a-59795ac19dda admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:04:14.425616 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-7e411315-ef97-4cc1-863a-59795ac19dda admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.393998 Sep 01 09:04:14.426139 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Sep 1 09:04:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:05:08.257092 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:05:08.258057 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-05570adf-a8e1-49f5-ada7-c9644eebd882 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 01 09:05:08.258454 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Thu Sep 1 09:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:05:08.268724 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:05:08.655850 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-e35ae67f-c6f3-40cb-b964-d3513aa53421 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:05:08.677106 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-e35ae67f-c6f3-40cb-b964-d3513aa53421 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412832 Sep 01 09:05:08.677637 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Thu Sep 1 09:05:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:05:08.699965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG dbcounter [-] [106061] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:05:08.703768 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-cf818a9c-4a3f-4b78-8c3f-f9776ea30bab admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:05:08.712121 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-cf818a9c-4a3f-4b78-8c3f-f9776ea30bab admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012980 Sep 01 09:05:08.713106 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Thu Sep 1 09:05:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:05:08.724750 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-154d8852-6895-424c-abf7-ac561112a04e admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:05:08.732567 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-154d8852-6895-424c-abf7-ac561112a04e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011394 Sep 01 09:05:08.733081 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Thu Sep 1 09:05:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:05:08.745232 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:05:08.753186 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012263 Sep 01 09:05:08.753707 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Thu Sep 1 09:05:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:05:08.765660 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-0a4ba5c9-17eb-4a33-8c51-dfad7f901c2e admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:05:08.773524 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-0a4ba5c9-17eb-4a33-8c51-dfad7f901c2e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011322 Sep 01 09:05:08.774677 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Thu Sep 1 09:05:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:08:13.257439 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:13.258511 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 09:08:13.258903 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:08:13.401858 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_api:SELECT=6 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:08:13.564010 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:13.567765 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:13.568244 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:13.568677 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:13.569421 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:13.569870 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:13.570287 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:13.604959 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-a2475068-360e-478e-baef-74d14ccec46b admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.204409 Sep 01 09:08:13.605531 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 09:08:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:08:14.492345 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:14.493344 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 01 09:08:14.493736 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:08:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:08:14.683550 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:14.686951 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:14.687462 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:14.687895 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:14.688657 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:14.689102 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:14.689521 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:14.709318 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-b9dafb6c-975e-40dd-936a-9a9b7f50e847 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077418 Sep 01 09:08:14.709794 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 09:08:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:08:25.954965 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:25.956010 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 01 09:08:25.956409 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:08:26.099381 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_cell0:SELECT=4 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:08:26.100101 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_cell1:SELECT=4 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:08:26.100735 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG dbcounter [-] [106062] Writing DB stats nova_api:SELECT=8 {{(pid=106062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:08:26.149951 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:26.153373 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:26.153847 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:26.154275 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:26.155014 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:26.155488 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:26.155907 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:26.181627 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-07f14917-57f7-4d74-875e-b476a19bec9c admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086600 Sep 01 09:08:26.182112 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 09:08:26 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:08:26.999839 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: DEBUG nova.api.openstack.wsgi [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] Calling method '>' {{(pid=106061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:27.000851 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: INFO nova.api.openstack.requestlog [None req-d4a8a6ae-4174-4d2e-a98b-3a111ae4dd69 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 01 09:08:27.001252 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: [pid: 106061|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Sep 1 09:08:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:08:27.190578 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG nova.api.openstack.wsgi [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] Calling method '>' {{(pid=106062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:08:27.194050 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:27.194516 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:27.194936 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:27.196173 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:08:27.196610 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:08:27.197018 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: DEBUG oslo_concurrency.lockutils [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:08:27.219962 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: INFO nova.api.openstack.requestlog [None req-fc47bbbe-c5fe-4019-834c-b977040d16a9 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080753 Sep 01 09:08:27.220434 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: [pid: 106062|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Sep 1 09:08:27 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:09:23.581217 dv-cinder-820027-23-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 09:09:23.581753 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: Thu Sep 1 09:09:23 2022 - graceful shutdown triggered... Sep 01 09:09:23.582173 dv-cinder-820027-23-iscsi devstack@n-api.service[106061]: Gracefully killing worker 1 (pid: 106061)... Sep 01 09:09:23.582534 dv-cinder-820027-23-iscsi devstack@n-api.service[106062]: Gracefully killing worker 2 (pid: 106062)... Sep 01 09:09:24.582671 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: worker 1 buried after 1 seconds Sep 01 09:09:24.583155 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: worker 2 buried after 1 seconds Sep 01 09:09:24.583155 dv-cinder-820027-23-iscsi devstack@n-api.service[106060]: goodbye to uWSGI. Sep 01 09:09:24.584311 dv-cinder-820027-23-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 09:09:24.584882 dv-cinder-820027-23-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 09:09:24.587774 dv-cinder-820027-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 09:09:24.599135 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 09:09:24.601735 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 09:09:24 2022] *** Sep 01 09:09:24.601886 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 09:09:24.602004 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 09:09:24.602121 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: nodename: dv-cinder-820027-23-iscsi Sep 01 09:09:24.602246 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: machine: x86_64 Sep 01 09:09:24.602360 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: clock source: unix Sep 01 09:09:24.602469 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: pcre jit disabled Sep 01 09:09:24.602571 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: detected number of CPU cores: 4 Sep 01 09:09:24.602711 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: current working directory: / Sep 01 09:09:24.602711 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: detected binary path: /usr/bin/uwsgi-core Sep 01 09:09:24.602711 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: your processes number limit is 47680 Sep 01 09:09:24.602711 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: your memory page size is 4096 bytes Sep 01 09:09:24.602711 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: detected max file descriptor number: 2048 Sep 01 09:09:24.602711 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: lock engine: pthread robust mutexes Sep 01 09:09:24.603194 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: thunder lock: enabled Sep 01 09:09:24.603194 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 09:09:24.603332 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 09:09:24.644202 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: Python main interpreter initialized at 0x5618a38429c0 Sep 01 09:09:24.644526 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: python threads support enabled Sep 01 09:09:24.644710 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: your server socket listen backlog is limited to 100 connections Sep 01 09:09:24.644866 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: your mercy for graceful operations on workers is 90 seconds Sep 01 09:09:24.647672 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 09:09:24.648013 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: *** Operational MODE: preforking *** Sep 01 09:09:24.648596 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: *** uWSGI is running in multiple interpreter mode *** Sep 01 09:09:24.648735 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: spawned uWSGI master process (pid: 121042) Sep 01 09:09:24.649064 dv-cinder-820027-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 09:09:24.649797 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: spawned uWSGI worker 1 (pid: 121062, cores: 1) Sep 01 09:09:24.650355 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: spawned uWSGI worker 2 (pid: 121063, cores: 1) Sep 01 09:09:24.650685 dv-cinder-820027-23-iscsi devstack@n-api.service[121042]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 09:09:25.310461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 09:09:25.324720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 09:09:26.461388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:09:26.461388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: from cryptography.utils import int_from_bytes Sep 01 09:09:26.462445 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:09:26.462445 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: from cryptography.utils import int_from_bytes Sep 01 09:09:26.484248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:09:26.484248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: from cryptography.utils import int_from_bytes Sep 01 09:09:26.484827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 09:09:26.484827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: from cryptography.utils import int_from_bytes Sep 01 09:09:28.891872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 09:09:28.892505 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 09:09:28.892598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 09:09:28.892904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 09:09:28.893164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 09:09:28.893553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.893879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.894205 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.894525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.894629 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 09:09:28.894987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.895070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 09:09:28.895313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.895488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 09:09:28.895586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.895792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.895903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 09:09:28.896057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 09:09:28.896150 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.896368 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.896477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.896685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.896799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.897014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-23-iscsi {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.897116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.897393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.897502 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.897730 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.897837 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.898051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.898210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.898361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.898505 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.898687 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.898838 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.899014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.899202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.899370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.899525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.899680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.899872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.901887 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-23-iscsi {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.902145 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.902355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.902579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.902789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.902996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.903223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.903445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.903656 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.903890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.904097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.904312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.904526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.904740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.904963 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.905169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.905389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.905626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.905851 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.906058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.906283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.906502 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-23-iscsi {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.906719 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.906925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.907136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.907330 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.907530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.907703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.907884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.908105 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.908268 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.908430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.908589 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.908775 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.908923 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.909927 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.910125 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.910284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.910444 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-23-iscsi {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.910595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.910745 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.910902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.911054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.911243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.911401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.911934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.911934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.912236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.912382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.912531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.912673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.912882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.913030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.913187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.913339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.913490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.913662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.913819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.913976 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.914119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.914261 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.914411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.914556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.914705 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.914858 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.915011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.915173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.915427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.915599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.915770 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.915959 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.915959 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.916261 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.916405 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.916549 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.916706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.916852 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.917643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.917793 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.918010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.918220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.918379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.918532 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.918677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.918819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.918960 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.919119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.919281 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.919780 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.919945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.920275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.920429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.920594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.920743 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.920917 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.921163 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.921335 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.921494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.921664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.922121 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.922282 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.922434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.922578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.922578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.922879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.923024 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.923200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.923488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.923658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.923823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.923979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.924124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.924266 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.924415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.924568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.924726 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.924878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.924878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.925681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.925838 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.925994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.926160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.926313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.926467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.927192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.927358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.927515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.927707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.927861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.928005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.928161 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.928347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.928505 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.928657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.928807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.928952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.929101 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.929247 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.929472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.929975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.930136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.930322 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.930491 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.930644 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.930797 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.930941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.931093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.931317 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.931471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.931622 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.931622 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.932087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.932087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.932500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.932668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.932921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.933079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.933225 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.933369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.933512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.933672 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.933831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.933831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.934203 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.934354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.934497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.934497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.934777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.934777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.935079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.935245 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.935389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.935543 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.935697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.935848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.935991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.936141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.936294 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.936446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.936590 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.936739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.936891 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.937048 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.937193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.937346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.937490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.937640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.937796 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.937940 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.938084 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.938241 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.938737 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.938994 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.939360 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.940123 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.940296 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.940452 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.940612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.940775 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.940926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.941071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.941222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.941380 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.941533 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.941687 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.941832 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.941986 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.942296 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.942460 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.942614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.942864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.943133 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.943287 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.943442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.943609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.943791 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.943948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.943948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.944229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.944392 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.944538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.944681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.944834 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.944986 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.945130 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.945282 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.945434 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.945578 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.945728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.945871 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.946022 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.946178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.946343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.946488 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.946638 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.946781 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.946931 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.946931 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.947268 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.947415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.947565 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.947716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.947874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.948065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.948225 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.948368 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.948552 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.948701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.948858 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.949003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.949154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.949297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.949440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.949583 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.949738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.949908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 09:09:28.950448 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.950615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.950760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.950918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.951071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.951071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.951391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.951535 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.951678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.951830 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.951974 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.952126 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.952442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.952600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.952757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.952931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.953283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.953457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.953614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.953767 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.953910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.954054 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.954207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.954360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.954511 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.954655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.954810 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.954961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.955131 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.955294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.955448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.955593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.955736 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.955887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.956039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.956190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.956334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.956479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.956631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.956793 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.956946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.957090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.957233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.957383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.957528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.957756 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.957911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.958056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.958205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.958356 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.958501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.958702 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.958861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.959006 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.959266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.959427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.959588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.959741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.959892 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.960035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.960194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.960693 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.960851 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.960997 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.961159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.961303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.961303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.961581 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.961739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.961883 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.962033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.962184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.962328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.962625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.962789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.962949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.963095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.963469 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.964257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.964412 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.964575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.964722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.964874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.965025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.965168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.965325 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.965469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.965619 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.965763 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.965913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.966074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.966233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.966386 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.966563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.966718 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.966869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.967013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.967206 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.967365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.967661 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.967833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.967989 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.968140 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.968307 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.968459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.968611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.968805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.968954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.969113 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.969264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.969408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.969558 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.969702 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.969852 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.970008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.970161 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.970338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.970792 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.970944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.971097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.971278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.971431 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.971575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.971575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.971869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.972020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.972179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.972330 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.972485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.972776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.972933 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.973088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.973241 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.973409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.973761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.973976 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.974135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.974294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.974446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.974596 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.974739 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.974902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.975053 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.975241 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.975396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.975541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.975690 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.975955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.976119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.976119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.976412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.976412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.976683 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.976834 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.977002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.977153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.977307 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.977462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.977607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.977749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.977905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.978049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.978192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.978336 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.978486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.978637 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.978833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.978998 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.979240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.980017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.980172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.980350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.980512 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.980961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.981125 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.981277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.981436 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.981591 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.981591 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.981884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.982036 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.982180 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.982330 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.982518 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.982714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.983010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.983186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.983336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.983336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.983829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.984003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.984230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.984400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.984546 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.984697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.984850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.985003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.985147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.985290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.985431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.985583 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.985729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.985879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.986030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.986179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.986332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.986502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.986646 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.986789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.986945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.987095 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.987273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.987432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.987583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.987734 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.987878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.988021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.988170 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.988170 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.988466 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.988616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.988767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.988965 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.989129 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.989282 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.989433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.989585 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.989729 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.989871 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.990097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.990245 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.990401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.990552 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.990703 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.991168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.991343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.991496 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.991640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.991783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.991926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.992070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.992223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.992374 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.992535 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.992679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.992827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.993158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.993158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.993480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.993625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.993768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.994090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.994268 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.994478 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.994627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.994781 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.994944 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.995149 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.995317 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.995469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.995612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.995755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.995897 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.996039 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.996191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.996336 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.996480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.996628 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.996781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.996941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.997098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.997250 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.997401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.997551 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.997702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.997855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.997999 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.998141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.998291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.998435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.998584 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.998737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.998890 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.999082 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.999260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.999415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.999566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.999724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:28.999882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.000034 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.000185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.000329 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.000480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.000632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.000777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.001187 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.001344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.001489 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.001489 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.001773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.001918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.002068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.002212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.002362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.002520 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.002671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.002823 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.002921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.003210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.003350 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.003494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.003627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.003762 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.003898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.004050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.004355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.004512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.004717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.004853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.004981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.005110 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.005253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.005398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.005529 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.005659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.005795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.005925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006063 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006193 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.006995 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.007137 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.007267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.007409 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.007546 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.007686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.007824 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.007985 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.008122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.008252 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.008381 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.008522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.008652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.008780 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.008910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.009038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.009217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.009354 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.009491 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.009628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.009758 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.009888 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010163 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010553 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010860 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.010993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.011578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.011719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.011850 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.012000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.012141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.012141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.012440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.012580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.012723 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.012868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.013000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.013137 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.013420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.013555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.013692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.013833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.014018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.014154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.014469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.014684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.014878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.015018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.015175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.015318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.015641 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.015795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.015795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016587 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016845 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.016845 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.017100 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.017245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.017376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.017513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.017513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.017764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.017908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018808 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.018945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.019075 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.019359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.019359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.019623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.019754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.019754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.020799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.021053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.021182 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.021318 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.021720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.021867 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022006 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022006 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022250 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022387 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022387 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022650 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.022901 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.023017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.023017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.023267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.023556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.023556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.023816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.023947 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.024084 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.024229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.024229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.024647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.024791 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.024996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.025137 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.025276 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.025406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.025406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.025646 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.025781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.025781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.026102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.026744 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.026879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.027172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.027172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.027505 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.027639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.027639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.027883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028281 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028540 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028676 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028676 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.028928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.029070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.029070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.029362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.029497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.029497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.029746 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.029887 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.030817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.031362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.031500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.031911 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032455 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032723 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032723 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.032978 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.033107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.033107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.033374 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.033652 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.033795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.033930 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.033930 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.034199 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.034330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.034330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035520 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035656 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035785 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035919 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.035919 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036690 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036824 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.036966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037591 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.037990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.038239 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.038376 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.038505 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.038640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.038640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.038879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.039014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.039014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.039338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.039472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.039603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.039738 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.039868 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.040122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.040122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.040389 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.040527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.040527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.040797 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.040935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.041065 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.041207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.041207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.041453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.041596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.041596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.043374 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.043520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.043520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.043902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044053 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044333 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044333 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.044999 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.045344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.045479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.045610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.045610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.045879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.046010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.046145 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.046283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.046283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.046550 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.046758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.046890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047174 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047454 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.047973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048503 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.048898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.049154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.049290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.049290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.049584 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.049725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.049725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.049970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.050870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.051202 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.051348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.051481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.051618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.051618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.051871 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.052086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.052086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.052357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.052488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.052617 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.052752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.052752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.053008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.053148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.053481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.053617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.053617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.054016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.054156 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.054156 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.054424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.055508 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.055654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.055795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.055926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056067 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056067 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056285 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056670 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.056954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.057217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.057354 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.057354 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.057642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.057774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.057903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058032 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058032 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058813 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.058950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.059094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.059243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.059425 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.059608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.059741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.059966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.060116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.060369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.060508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.060707 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.060903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.061045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.061352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.061489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.061675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.061854 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.061989 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.062301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.062455 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.062633 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.062813 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.062956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.063281 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.063665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064396 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064666 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.064996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.065128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.065366 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.065717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.065870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.066003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.066147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.066286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.066415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.066556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.066864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.066998 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.067202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.067587 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.067749 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.067893 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.068049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.068196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.068339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.068471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.068748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.068895 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.069080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.069250 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.069393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.069720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.069827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.070121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.070221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.070459 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.070640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.070799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.071087 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.071225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.071449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.071551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.071777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.071886 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.072094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.072187 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.072412 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.072518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.072729 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.072834 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.073599 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.073745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.073922 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.074227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.074372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.074583 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.074717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.074925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.075060 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.075273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.075422 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.075619 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.075754 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.075946 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.076090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.076280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.076452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.076593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.076725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.076910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.077056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.077224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.077367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.077541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.077677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.077864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.078006 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.078181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.078317 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.078500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.078642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.078815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.079025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.079249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.079386 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.079524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.079695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.079832 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.080035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.080181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.080375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.080519 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.080696 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.080836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.081022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.081169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.081345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.081485 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.081663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.081799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.081981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.082116 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.082297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.082430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.082634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.082768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.082953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.083094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.083283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.083413 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.083620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.083766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.083953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.084094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.084279 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.084413 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.084601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.084738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.084931 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.085074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.085259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.085401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.085587 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.085731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.085995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.086141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.086281 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.086415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.086552 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.086692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.086857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.087000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.087204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.087352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.087535 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.087681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.087884 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.088115 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.088252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.088468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.088605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.089446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.089590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.089784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.089952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.090168 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.090323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.090493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.090637 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.090871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.090996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.091225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.091360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.091559 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.091690 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.091882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.092001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.092207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.092338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.092540 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.092658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.092873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.092998 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.093189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.093308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.093526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.093653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.093917 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.094047 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.094173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.094286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.094465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.094586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.094863 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.094993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.095142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.095458 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.095794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.096143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.096435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.096561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.096789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.096896 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.097125 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.097220 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.097468 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.097571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.097805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.097900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.098140 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.098242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.098472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.098574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.098787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.098886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.099132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100378 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100571 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100851 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.100939 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101107 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.101864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.102045 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.102186 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.102365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.102507 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.102703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.102845 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.103026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.103341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.103486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.103673 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.103806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.103988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.104121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.104369 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.104514 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.104713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.104893 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.105171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.105318 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.105464 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.105605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.105743 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.105875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.106006 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.106191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.106356 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.106523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.106659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.106856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.106991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.107213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.107363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.107547 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.107683 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.107877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.108019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.108204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.108339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.108525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.108665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.108847 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.108988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.109170 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.109400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.109545 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.109766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.110052 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.110190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.110394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.110546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.110721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.110857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.111047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.111264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.111400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.111539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.111710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.111859 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.112033 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.112181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.112353 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.112488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.112676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.112812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.112998 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.113141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.113318 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.113460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.113633 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.113759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.113958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.114102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.114281 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.114416 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.114598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.114735 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.114923 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.115067 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.115263 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.115385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.115605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.115732 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.115925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.116068 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.116245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.116387 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.116564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.116712 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.116890 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.117032 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.117211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.117346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.117529 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.117677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.117849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.117985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.118167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.118302 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.118494 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.118643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.118811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.118948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.119151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.119300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.119471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.119606 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.119790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.119933 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.120119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.120257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.120470 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.120666 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.120803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.120935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.121135 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.121281 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.121469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.121591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.121797 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.121920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.122127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.122247 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.122454 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.122582 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.122788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.122989 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.123129 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132028 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132274 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.132984 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133067 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133161 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133246 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133589 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133771 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.133969 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134060 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134325 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134514 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.134984 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.135077 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.135234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.135234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.135428 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.135514 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.136294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.136402 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.136498 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.136625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.136730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.136857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.136951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137123 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137390 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137742 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.137931 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138509 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138876 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.138972 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139059 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139488 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139581 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139858 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.139943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140036 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140253 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.140997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141282 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141763 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.141939 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142047 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142330 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142426 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142513 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142688 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.142931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143129 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143336 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143762 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143848 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.143941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.144995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145521 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145735 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145826 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.145910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.146002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.146098 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.146213 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.146393 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.146548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.146717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.146814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.147026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.147284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.147432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.147530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.147710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.147808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.148038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.148147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.148363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.148502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.148684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.148776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.149000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.149108 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.149316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.149410 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.149630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.149732 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.149949 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.150055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.150298 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.150407 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.150591 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.150697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.150914 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.151020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.151806 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.151921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.152214 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.152345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.152469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.152664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.152784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.153007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.153128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.153341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.153477 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.153674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.153804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.153997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.154117 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.154342 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.154475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.154661 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.154787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.154975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.155157 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.157762 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158011 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158211 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158298 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.158913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159007 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159219 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.159949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160540 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160723 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.160916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161009 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161458 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.161910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.162003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.162096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.162190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.162409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.162503 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.162736 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.162838 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.163069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.163235 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.163416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.163517 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.163729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.163822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.164044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.164147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.164364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.164465 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.164717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.164824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.164997 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.165113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.165312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.165455 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.165626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.165782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.165945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.166104 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.166379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.166483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.166716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 09:09:29.166820 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.167563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.167856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.168172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.168486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.168804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.169131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.169437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.169748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.170061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.170374 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.170718 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.171063 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.171437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.171773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.172095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.172430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.172751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.173085 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.173419 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.173749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.174070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.174413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.174733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.175055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.175404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.175726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.176049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.176376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.176729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.177048 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.177364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.177706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.178033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.178367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.178695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.179019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.179383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.179707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.180027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.180345 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.180667 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.180988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.181314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.181634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.181954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.182280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.183207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.183512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.183851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.184173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.184512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.184853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.185212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.185538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.185894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.186234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.186561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.186887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.187226 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 09:09:29.187486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 09:09:29.228407 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO dbcounter [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Registered counter for database nova_api Sep 01 09:09:29.249417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO dbcounter [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Registered counter for database nova_api Sep 01 09:09:29.249624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_db.sqlalchemy.engines [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.256155 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writer thread running {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.269273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_db.sqlalchemy.engines [None req-472efb40-f848-4996-b075-142800c2fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.275771 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writer thread running {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.314000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.context [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b35e4d9-fea5-4082-84bb-222d74bca9ee(cell1) {{(pid=121062) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 09:09:29.318050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:09:29.318596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:09:29.320224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:09:29.320963 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:09:29.321417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:09:29.323592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:09:29.325590 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO dbcounter [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Registered counter for database nova_cell0 Sep 01 09:09:29.329726 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO dbcounter [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Registered counter for database nova_cell1 Sep 01 09:09:29.333116 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.context [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b35e4d9-fea5-4082-84bb-222d74bca9ee(cell1) {{(pid=121063) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 09:09:29.337107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_db.sqlalchemy.engines [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.337284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:09:29.337752 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:09:29.338467 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_db.sqlalchemy.engines [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.339582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:09:29.341304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:09:29.341304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:09:29.342808 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:09:29.344872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO dbcounter [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Registered counter for database nova_cell0 Sep 01 09:09:29.345678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writer thread running {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.347275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writer thread running {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.348955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO dbcounter [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Registered counter for database nova_cell1 Sep 01 09:09:29.358277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_db.sqlalchemy.engines [None req-472efb40-f848-4996-b075-142800c2fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.361274 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_db.sqlalchemy.engines [None req-472efb40-f848-4996-b075-142800c2fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.366433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writer thread running {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.369167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writer thread running {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.496292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO dbcounter [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Registered counter for database nova_cell0 Sep 01 09:09:29.503221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_db.sqlalchemy.engines [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.507770 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writer thread running {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.520457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO dbcounter [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Registered counter for database nova_cell0 Sep 01 09:09:29.528190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_db.sqlalchemy.engines [None req-472efb40-f848-4996-b075-142800c2fd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 09:09:29.532748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writer thread running {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 09:09:29.833114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: WARNING keystonemiddleware.auth_token [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:09:29.841135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: WARNING keystonemiddleware.auth_token [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:09:29.855980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: WARNING keystonemiddleware.auth_token [None req-472efb40-f848-4996-b075-142800c2fd63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:09:29.863449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: WARNING keystonemiddleware.auth_token [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:09:30.188432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: WARNING keystonemiddleware.auth_token [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:09:30.194483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: WARNING keystonemiddleware.auth_token [None req-68ad8c4c-3eef-4a04-9cca-a506285afc7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:09:30.200086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618a38429c0 pid: 121062 (default app) Sep 01 09:09:30.212621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: WARNING keystonemiddleware.auth_token [None req-472efb40-f848-4996-b075-142800c2fd63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 09:09:30.219486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: WARNING keystonemiddleware.auth_token [None req-472efb40-f848-4996-b075-142800c2fd63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 09:09:30.224799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618a38429c0 pid: 121063 (default app) Sep 01 09:10:07.695085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:07.695966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:07.696782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:07.697539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:08.834306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4630e972-0fe9-4dc3-8fef-80ac0fac47c8 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Action: 'create', calling method: .version_select at 0x7f7a663d8280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-101384281", "metadata": {"Type": "work"}}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:10.206726 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4630e972-0fe9-4dc3-8fef-80ac0fac47c8 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.530183 Sep 01 09:10:10.208671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 09:10:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2534 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 09:10:10.225567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:10.225567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:10.226365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:10.235885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:10.553525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4b84783e-2616-4ed2-be4e-b54d520df8b5 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Calling method '.version_select at 0x7f7a66476f70>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:11.063879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4b84783e-2616-4ed2-be4e-b54d520df8b5 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1" status: 200 len: 352 microversion: 2.1 time: 0.844472 Sep 01 09:10:11.065043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:10 2022] GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 => generated 352 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:11.529916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ee9a9881-9158-48ac-9e30-e99605aedf15 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a662c5160>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:11.651904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ee9a9881-9158-48ac-9e30-e99605aedf15 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/67c93faa-223f-483b-8f9e-83136479060b" status: 200 len: 350 microversion: 2.1 time: 0.130562 Sep 01 09:10:11.653967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:11 2022] GET /compute/v2.1/os-volumes/67c93faa-223f-483b-8f9e-83136479060b => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:12.083223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-91ca2060-6a01-48d3-b0de-7e15f370d898 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Calling method '.version_select at 0x7f7a662a41f0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:12.178094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-91ca2060-6a01-48d3-b0de-7e15f370d898 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1" status: 200 len: 353 microversion: 2.1 time: 0.102839 Sep 01 09:10:12.183012 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:12 2022] GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:12.193391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e9a75f73-c837-44fb-9396-2340244885c7 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Calling method '.version_select at 0x7f7a662c58b0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:12.280524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e9a75f73-c837-44fb-9396-2340244885c7 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1" status: 200 len: 353 microversion: 2.1 time: 0.090966 Sep 01 09:10:12.281410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:12 2022] GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:12.302290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-037e7a76-2b25-4cad-a2b1-a39cb3bd2079 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Calling method '.version_select at 0x7f7a662a4790>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:12.617941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-037e7a76-2b25-4cad-a2b1-a39cb3bd2079 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1" status: 202 len: 0 microversion: 2.1 time: 0.320819 Sep 01 09:10:12.618760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:10:12 2022] DELETE /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:10:12.631851 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-acabdba1-5942-4ea6-8137-2729d16db065 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Calling method '.version_select at 0x7f7a662c5f70>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:12.736291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-acabdba1-5942-4ea6-8137-2729d16db065 tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1" status: 200 len: 352 microversion: 2.1 time: 0.113015 Sep 01 09:10:12.737568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:12 2022] GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:13.751144 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-54929de6-acc8-49bf-8f73-0c9065b0931d tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Calling method '.version_select at 0x7f7a662a4a60>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:13.798410 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-54929de6-acc8-49bf-8f73-0c9065b0931d tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] HTTP exception thrown: Volume 71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 could not be found. Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-54929de6-acc8-49bf-8f73-0c9065b0931d tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Request method failure captured: Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 HTTP/1.1 Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHbvPHDqvQKzzar2ZCZMxvZwWY5ifKgxmc6G4hHaEKNXGR_o09lq7T-yj2dtL54HrloVwx1M6vGT34X71Gp-BLjKPi1Otv7AasecnvmAd2VVbYrUokgoVoEURC_WBSy1cZJOXoikGe2BQhxFapyOR8-7aKOxttD8sHR9t8hsDpu68tk Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 8ceea16a8d9244f2907a2662436a8fda Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-VolumesGetTestJSON-1071604902 Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:10:13.802453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ceea16a8d9244f2907a2662436a8fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8ceea16a8d9244f2907a2662436a8fda", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ceea16a8d9244f2907a2662436a8fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8ceea16a8d9244f2907a2662436a8fda"}]}] Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-VolumesGetTestJSON-1071604902 Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 8ceea16a8d9244f2907a2662436a8fda Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-VolumesGetTestJSON-1071604902 Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-VolumesGetTestJSON-1071604902-project Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: c9da0e0fd0d64db49da1f65bff93ac36 Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-VolumesGetTestJSON-1071604902-project Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Volume 71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 could not be found. Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1'} Sep 01 09:10:13.803601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 could not be found. (HTTP 404) (Request-ID: req-7b85ffa7-5486-46b5-a3f4-74892710e91b) Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:10:13.804358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:10:13.805305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 could not be found. Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 09:10:13.806203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 could not be found. Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 could not be found. Sep 01 09:10:13.807091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:10:13.810360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-54929de6-acc8-49bf-8f73-0c9065b0931d tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] Returning 404 to user: Volume 71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:10:13.811459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-54929de6-acc8-49bf-8f73-0c9065b0931d tempest-VolumesGetTestJSON-1071604902 tempest-VolumesGetTestJSON-1071604902-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1" status: 404 len: 109 microversion: 2.1 time: 0.065578 Sep 01 09:10:13.815541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:13 2022] GET /compute/v2.1/os-volumes/71a2f4aa-cc03-4eaa-a05c-9229c9afb0d1 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:10:14.687653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-eaa7be45-fce3-4f55-97ac-0bcbb6f3bfcb tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a662c5b80>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:14.789970 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-eaa7be45-fce3-4f55-97ac-0bcbb6f3bfcb tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/45e8e30a-0d8b-438a-b000-0321557ae214" status: 200 len: 351 microversion: 2.1 time: 0.105086 Sep 01 09:10:14.789970 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:14 2022] GET /compute/v2.1/os-volumes/45e8e30a-0d8b-438a-b000-0321557ae214 => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:18.157931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-74250cb5-abbf-4454-a8d1-f67a17d79504 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a66c1e700>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:18.303224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-74250cb5-abbf-4454-a8d1-f67a17d79504 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1c4a8a33-a2cb-411d-a6f6-3704d2b5aa53" status: 200 len: 351 microversion: 2.1 time: 0.162082 Sep 01 09:10:18.306223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:10:18 2022] GET /compute/v2.1/os-volumes/1c4a8a33-a2cb-411d-a6f6-3704d2b5aa53 => generated 351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:18.324038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2771815b-6f5c-4833-9905-7469569a3cb7 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a662c5430>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:18.519005 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2771815b-6f5c-4833-9905-7469569a3cb7 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.200264 Sep 01 09:10:18.531294 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Sep 1 09:10:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:18.537259 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-98cab586-d97e-4945-8f0c-e947db91384e tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a6626cf70>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:18.851301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-98cab586-d97e-4945-8f0c-e947db91384e tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.320087 Sep 01 09:10:18.855562 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Sep 1 09:10:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:18.873405 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9b1b498e-d311-4f47-a58a-360c43bde858 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a662c6940>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:19.108732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9b1b498e-d311-4f47-a58a-360c43bde858 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.243008 Sep 01 09:10:19.111151 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Sep 1 09:10:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:19.124177 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-320d823a-1699-4e01-ab97-1bbe2e88c126 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a6626c8b0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:19.410910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-320d823a-1699-4e01-ab97-1bbe2e88c126 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.291526 Sep 01 09:10:19.414894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Sep 1 09:10:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:19.429306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d03423f8-1d8c-4cbb-8e3f-b5423d5ed077 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a662c6d30>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:19.673235 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d03423f8-1d8c-4cbb-8e3f-b5423d5ed077 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.247922 Sep 01 09:10:19.673815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 8/15] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Sep 1 09:10:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:19.689132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9266c73d-af2e-43ff-8de7-b1188de93b9c tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a662b5430>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:19.974366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9266c73d-af2e-43ff-8de7-b1188de93b9c tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.289927 Sep 01 09:10:19.975054 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Sep 1 09:10:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:10:19.996071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a62d41a1-f9cf-4076-9416-2734a28ec023 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a662c5280>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:20.126573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a62d41a1-f9cf-4076-9416-2734a28ec023 tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.141458 Sep 01 09:10:20.127528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1188 bytes} [Thu Sep 1 09:10:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:20.144213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cfb491c2-1021-495b-9733-0fa3359dd22a tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] Calling method '.version_select at 0x7f7a6622c670>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:20.406102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cfb491c2-1021-495b-9733-0fa3359dd22a tempest-VolumesTestJSON-2078577182 tempest-VolumesTestJSON-2078577182-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.265341 Sep 01 09:10:20.409168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Sep 1 09:10:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:21.241063 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fc97e0bf-c658-4767-89f5-37e3ef9933b3 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: .version_select at 0x7f7a66257430>, body: {"keypair": {"name": "tempest-keypair-299141689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChFzBVahSAyHB/NqoMgk0rYkeXO3y2zGdG/MOuAxPwjH0NOrHtVrhkwLwqhws7oPrddsn2LXuHykkOCB7cNNIX4xVBtD02PvsE69h1fQtbDNp/EoedNnij6kaDnMBSWKg=="}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:21.421786 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-fc97e0bf-c658-4767-89f5-37e3ef9933b3 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:21.440382 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-fc97e0bf-c658-4767-89f5-37e3ef9933b3 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:21.678142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fc97e0bf-c658-4767-89f5-37e3ef9933b3 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.301829 Sep 01 09:10:21.679027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 10/19] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:10:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:21.806463 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-164997452", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "networks": [{"uuid": "b7c0d6be-e38f-4a47-842c-71eb2f18d88c"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:22.052103 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] validate_networks() for [('b7c0d6be-e38f-4a47-842c-71eb2f18d88c', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:10:24.388406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:10:24.388406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:10:24.388406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:10:24.388406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:10:24.388406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:10:24.422603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:24.423131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:24.423597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:24.424316 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:24.424791 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:24.425179 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:24.548465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Getting quotas for project e27cafb5f07e449295c45c033ee62256. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:24.576495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Getting quotas for user f6d6f82f9aa6447591cdd55d2a040ea4 and project e27cafb5f07e449295c45c033ee62256. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:24.631695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:10:24.641504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:10:24.880353 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ba92d033-5fc1-4afc-b257-86b6372410e5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.224010 Sep 01 09:10:24.899755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:10:24.906044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8b42aaa3-457e-473a-acc4-886859356df7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:24.907527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8b42aaa3-457e-473a-acc4-886859356df7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:25.172227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8b42aaa3-457e-473a-acc4-886859356df7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:25.242109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8b42aaa3-457e-473a-acc4-886859356df7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1214 microversion: 2.1 time: 0.308131 Sep 01 09:10:25.242109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 11/21] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:24 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:26.257446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dedc6722-598e-405d-9dae-de00702766e6 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:26.257985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dedc6722-598e-405d-9dae-de00702766e6 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:26.805191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dedc6722-598e-405d-9dae-de00702766e6 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:26.845482 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dedc6722-598e-405d-9dae-de00702766e6 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1214 microversion: 2.1 time: 0.592394 Sep 01 09:10:26.869354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 11/22] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:26 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1214 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:26.885640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-aa46af37-f5f5-406b-80cd-7e947644ffe5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'create', calling method: .version_select at 0x7f7a661d0670>, body: {"keypair": {"name": "tempest-keypair-2017900709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjcoUjBR2NVLRLT0O1s35g2Rbfn1atSh3R6TXTQqReBBQn78oEN7bw7W/Pb7jNFmkHeRFW1C97FpbahiAS1d+bp4Q7mW+QD96TkLBxaKNVDLcqmZfDZXw00lnBmGxPGwg=="}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:26.938826 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-aa46af37-f5f5-406b-80cd-7e947644ffe5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:26.949249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-aa46af37-f5f5-406b-80cd-7e947644ffe5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for user 004ab0c0b138457e9a5e9288d039b932 and project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:27.088080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-aa46af37-f5f5-406b-80cd-7e947644ffe5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.550304 Sep 01 09:10:27.088945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 12/23] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:10:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:27.876970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:27.877804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:27.907312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:27.907312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:27.907312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:27.910029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:27.910836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:27.911775 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:28.238464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:28.281924 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4fc80f82-ab21-4b84-8312-b3681b4cbbbb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1218 microversion: 2.1 time: 0.409815 Sep 01 09:10:28.282962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:27 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1218 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:29.312709 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:29.313996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:29.339040 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:29.341531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:29.344604 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:29.345415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:29.346750 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:29.347225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:29.879970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2021300224", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:29.937650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:29.976391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8f7c263b-1ad3-4251-aeb3-c627cf61d399 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1266 microversion: 2.1 time: 0.677219 Sep 01 09:10:29.978271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:29 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1266 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:29.987003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-490905633", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d95d47db-eb5b-4df8-8295-e8765bcebf85"}], "security_groups": [{"name": "tempest-securitygroup--1831021563"}], "key_name": "tempest-keypair-299141689", "user_data": "}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:30.037863 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] validate_networks() for [('c9bfe5de-813e-4a58-8ca9-0d815bfc6f58', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:10:30.563904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] validate_networks() for [('d95d47db-eb5b-4df8-8295-e8765bcebf85', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:10:31.401236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:10:31.407804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:10:31.407804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:10:31.407804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:10:31.407804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:10:31.438219 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:31.440643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:31.441366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:31.445525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:31.447023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:31.447760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:31.494809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:31.505024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for user 81816508df7c431fa3b4b495d11ac101 and project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:31.531839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:10:31.544828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:10:31.816417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cec3dabd-d17b-4604-8e67-7bd1fd2f6aff tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.186529 Sep 01 09:10:31.817697 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 13/26] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:10:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 09:10:32.634002 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-328a2022-16d4-4ca3-97af-49b5dd8da42a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'create', calling method: .version_select at 0x7f7a658531f0>, body: {"keypair": {"name": "tempest-keypair-258519305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ1XWHVWCCiur1dux6fZdhXJL5+L593lmQ88VsJxqjqO0RL0hILEDaXt0098jNM8EDVJjPu5/E1HsLiUMNRV4HIRE1GdFL4PYdk5aOP3i6zZcvhCVvjtDBhVDKVTYE//Q=="}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:32.697874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-328a2022-16d4-4ca3-97af-49b5dd8da42a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:32.722350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-328a2022-16d4-4ca3-97af-49b5dd8da42a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for user 3d931a379404433b9c3c690dd9beb83d and project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:32.876844 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-328a2022-16d4-4ca3-97af-49b5dd8da42a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.055785 Sep 01 09:10:32.887409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 14/27] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Sep 1 09:10:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1069 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 09:10:32.892619 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:32.893290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:32.918437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:32.918437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:32.918437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:32.918753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:32.921104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:32.923142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:33.579206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:33.579206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b6acfea7-e436-446b-a2e8-ed3db8a1796d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.681913 Sep 01 09:10:33.579206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:32 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:33.600092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2f54fe91-97ea-44a5-998a-75465f8e746b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:33.601885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2f54fe91-97ea-44a5-998a-75465f8e746b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:33.843433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2f54fe91-97ea-44a5-998a-75465f8e746b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:33.857002 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2f54fe91-97ea-44a5-998a-75465f8e746b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1222 microversion: 2.1 time: 0.283012 Sep 01 09:10:33.858816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 16/29] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:33 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1222 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:33.868458 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-258740183", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39395f6c-959b-4db4-96d8-3a8b29f2e36f"}], "security_groups": [{"name": "tempest-securitygroup--1947722"}], "key_name": "tempest-keypair-2017900709", "user_data": "}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:34.030758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:10:34.031376 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:10:34.032477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:10:34.034537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:10:34.035059 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:10:34.070950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:34.092305 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:34.094381 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:34.095890 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:34.096627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:34.097297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:34.219822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:34.226410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:34.266528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:10:34.277497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:10:34.281890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] validate_networks() for [('39395f6c-959b-4db4-96d8-3a8b29f2e36f', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:10:34.591981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b6a7a528-64cf-40db-bdab-f46a12eb6712 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.612162 Sep 01 09:10:34.594229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 14/30] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:10:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 4615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:10:34.600495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:34.601774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:34.611303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:34.617766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:34.617766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:34.617766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:34.617766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:34.618105 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:35.523699 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:35.541534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-46c1867a-d13f-4966-a331-cca7a88d102f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.943037 Sep 01 09:10:35.546375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 15/31] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:34 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:35.582051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-400a09bb-88fd-45a9-a800-817b04a0b4a5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:35.583862 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-400a09bb-88fd-45a9-a800-817b04a0b4a5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:36.078793 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-400a09bb-88fd-45a9-a800-817b04a0b4a5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:36.097132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-400a09bb-88fd-45a9-a800-817b04a0b4a5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1240 microversion: 2.1 time: 0.547425 Sep 01 09:10:36.103202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 16/32] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:35 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1240 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:36.143603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-44948785", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:36.187987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:10:36.189111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:10:36.189808 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:10:36.190436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:10:36.191337 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:10:36.209954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:36.211994 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:36.213169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:36.214735 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:36.217793 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:36.218695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:36.295450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:36.317227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for user 004ab0c0b138457e9a5e9288d039b932 and project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:36.322933 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] validate_networks() for [('c9bfe5de-813e-4a58-8ca9-0d815bfc6f58', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:10:36.379249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:10:36.384233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:10:36.650995 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c9206fdc-b345-4d69-aef6-f7fb1e6e1177 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.790185 Sep 01 09:10:36.661424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 17/33] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:10:33 2022] POST /compute/v2.1/servers => generated 399 bytes in 2802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:10:36.675180 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:36.693421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:36.724235 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:36.742547 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:36.743657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:36.745799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:36.749011 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:36.751313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:37.332554 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:37.374528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3c8fe440-ecc8-4a85-96f7-2fe05ad1ac7b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.708176 Sep 01 09:10:37.375425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 18/34] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:36 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:37.404971 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-480a2117-4fb8-4c89-b7a1-daeaa4a833c6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:37.405851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-480a2117-4fb8-4c89-b7a1-daeaa4a833c6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:37.550512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-480a2117-4fb8-4c89-b7a1-daeaa4a833c6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:37.559566 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-480a2117-4fb8-4c89-b7a1-daeaa4a833c6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1237 microversion: 2.1 time: 0.182580 Sep 01 09:10:37.563580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 19/35] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:37 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1237 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:37.587305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:37.591676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:37.623862 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:37.627421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:37.628129 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:37.629035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:37.630563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:37.631005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:37.912425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:37.923808 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e89beef3-e48d-42fb-a555-31ffa9731bbc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1244 microversion: 2.1 time: 0.358810 Sep 01 09:10:37.924598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 20/36] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:37 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1244 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:38.405690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:38.407989 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:38.430185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:38.430867 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:38.431756 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:38.432730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:38.434372 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:38.435446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:38.700246 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:38.712492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cb7fd56b-30f9-494e-9797-f25e895d09d4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.310602 Sep 01 09:10:38.727851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 21/37] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:38 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:38.740848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:38.741717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:38.755940 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:38.756447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:38.756884 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:38.757583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:38.758034 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:38.759611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:39.027797 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:39.046284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-26ddddaa-2abd-4560-b628-e9f037b3ea33 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1241 microversion: 2.1 time: 0.315744 Sep 01 09:10:39.063550 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 22/38] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:38 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1241 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:39.063550 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:39.072595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:39.092629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:39.092629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:39.092629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:39.093119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:39.093577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:39.094011 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:39.279605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:39.288738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5b0c973c-ceae-4995-ac92-a117ad869614 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1292 microversion: 2.1 time: 0.240460 Sep 01 09:10:39.294329 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 23/39] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:39 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1292 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:39.468661 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:10:39.469886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:10:39.470830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:10:39.471939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:10:39.472592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:10:39.516266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:39.519948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:39.521769 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:39.524992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:39.525650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:39.529399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:39.575803 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:39.586489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for user 81816508df7c431fa3b4b495d11ac101 and project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:39.630621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:10:39.659286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:10:39.673946 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2090299926", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c04be92-b1d0-4cd9-b4e5-6bb7a8617d5d"}], "security_groups": [{"name": "tempest-securitygroup--2114833681"}], "key_name": "tempest-keypair-258519305", "user_data": "}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:40.227946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-09858552-ab8e-4c8f-8df1-0fd7c01bd5fd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.123280 Sep 01 09:10:40.247948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 17/40] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:10:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 4126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:10:40.247948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:40.247948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:40.278248 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:40.278248 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:40.278248 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:40.282213 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:40.287874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:40.288602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:40.425186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] validate_networks() for [('1c04be92-b1d0-4cd9-b4e5-6bb7a8617d5d', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:10:41.681362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:41.689396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64903205-10ff-4f12-bfab-57b9143b937d tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 1.457790 Sep 01 09:10:41.694468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 18/41] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:40 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:41.714576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:41.721282 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:41.746515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:41.749757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:41.751338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:41.753213 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:41.756038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:41.756738 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:41.987540 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:42.010927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-99976bf9-5940-4e3d-a729-54dc7cdb8ee5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1289 microversion: 2.1 time: 0.312540 Sep 01 09:10:42.024384 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 19/42] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:41 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1289 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:42.029977 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0b7ff020-291f-4a17-a434-56aa22f9d96a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:42.030614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0b7ff020-291f-4a17-a434-56aa22f9d96a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:42.110123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0b7ff020-291f-4a17-a434-56aa22f9d96a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:42.140403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0b7ff020-291f-4a17-a434-56aa22f9d96a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1220 microversion: 2.1 time: 0.114790 Sep 01 09:10:42.141108 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 20/43] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:42 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:42.155458 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:42.158214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:42.173848 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:42.174364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:42.174814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:42.178581 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:42.179221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:42.180644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:42.345000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:10:42.345685 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:42.346370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:10:42.347123 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:10:42.351047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:10:42.351047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:10:42.351047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:42.369017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-367a4327-6242-4eac-b9bf-3c5f71999246 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1298 microversion: 2.1 time: 0.220714 Sep 01 09:10:42.373974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:42.373974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:42.373974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:42.373974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:42.374295 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:42.374295 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:42.374495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 21/44] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:42 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1298 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:42.417393 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:10:42.425714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for user 3d931a379404433b9c3c690dd9beb83d and project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:10:42.449753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:10:42.455811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:10:42.637141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a791c5e7-ff61-4389-ad3e-482613d14b46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.968205 Sep 01 09:10:42.656895 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 24/45] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Sep 1 09:10:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2989 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 09:10:42.670247 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1415fee0-5a7b-4f6a-9621-52d6cb4a5028 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:42.671535 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1415fee0-5a7b-4f6a-9621-52d6cb4a5028 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:42.818370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-171528a7-72c3-4b6a-8906-3d5b390235f0 req-3f376e10-fea8-4bf9-9941-b1c6e55614c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64746b2e-3205-48c6-83d4-77230c7226be", "tag": "3d27e768-35dd-45bf-b9b7-c2e5c51c8430"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:42.841873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-171528a7-72c3-4b6a-8906-3d5b390235f0 req-3f376e10-fea8-4bf9-9941-b1c6e55614c6 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:42.842703 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-171528a7-72c3-4b6a-8906-3d5b390235f0 req-3f376e10-fea8-4bf9-9941-b1c6e55614c6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:42.843348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-171528a7-72c3-4b6a-8906-3d5b390235f0 req-3f376e10-fea8-4bf9-9941-b1c6e55614c6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:42.874374 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-171528a7-72c3-4b6a-8906-3d5b390235f0 req-3f376e10-fea8-4bf9-9941-b1c6e55614c6 service nova] Creating event network-changed:3d27e768-35dd-45bf-b9b7-c2e5c51c8430 for instance 64746b2e-3205-48c6-83d4-77230c7226be on hv-cinder-82002 Sep 01 09:10:42.894529 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-171528a7-72c3-4b6a-8906-3d5b390235f0 req-3f376e10-fea8-4bf9-9941-b1c6e55614c6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 09:10:42.894957 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-171528a7-72c3-4b6a-8906-3d5b390235f0 req-3f376e10-fea8-4bf9-9941-b1c6e55614c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 09:10:42.899403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:42.900152 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:42.900643 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:42.901430 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:42.901902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:42.902364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:42.940369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.compute.rpcapi [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 09:10:42.945489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] Releasing lock "compute-rpcapi-router" {{(pid=121062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 09:10:42.984459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1415fee0-5a7b-4f6a-9621-52d6cb4a5028 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:42.995943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1415fee0-5a7b-4f6a-9621-52d6cb4a5028 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:43.004558 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6e4d4169-0267-42a0-bb82-a3ad217a2f86 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.630088 Sep 01 09:10:43.010244 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 22/46] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:43.014056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1415fee0-5a7b-4f6a-9621-52d6cb4a5028 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:43.016492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1415fee0-5a7b-4f6a-9621-52d6cb4a5028 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1281 microversion: 2.20 time: 0.358243 Sep 01 09:10:43.031741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 25/47] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:42 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1281 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:43.040839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:43.046008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:43.046542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:43.048608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:43.089497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.090938 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.091974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.092603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.092720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.093350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.093783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.093897 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.095634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.096556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.098086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.098548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.204477 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:43.213875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-30346f75-de72-4f42-9ec2-0527944b6827 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1297 microversion: 2.1 time: 0.180719 Sep 01 09:10:43.241444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 26/48] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:43 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1297 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:43.246537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:43.249118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:43.263554 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.266780 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.274192 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.279820 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.290389 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.291208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.442903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:43.464934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-261c2570-ee32-4d71-ac80-502c16dbe3d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1216 microversion: 2.1 time: 0.221734 Sep 01 09:10:43.477536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 27/49] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:43 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:43.490479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:43.493805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:43.509750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.510553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.511156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.512061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:43.512563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:43.513562 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:43.650704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:43.655855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:43.663565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5869abd9-6930-434a-9227-d868a98ce46b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.650166 Sep 01 09:10:43.665001 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 23/50] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:43 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:43.668003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e4abfb17-04a6-4388-b542-3cc29e43c2d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1298 microversion: 2.1 time: 0.188987 Sep 01 09:10:43.669719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 28/51] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:43 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1298 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:44.046486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c872906f-2a20-45e4-a350-ba5208377008 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:44.047211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c872906f-2a20-45e4-a350-ba5208377008 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:44.198782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c872906f-2a20-45e4-a350-ba5208377008 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:44.212474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c872906f-2a20-45e4-a350-ba5208377008 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:44.219208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c872906f-2a20-45e4-a350-ba5208377008 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:44.233343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c872906f-2a20-45e4-a350-ba5208377008 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1281 microversion: 2.20 time: 0.192038 Sep 01 09:10:44.445693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 24/52] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:44 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:44.446077 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:44.446077 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:44.446077 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:44.446077 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:44.446814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:44.446814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:44.446814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:44.446814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:44.447076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:44.447076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3cfb9c7e-6f2c-4e73-84dc-b02716bf4931 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1295 microversion: 2.1 time: 0.175200 Sep 01 09:10:44.447076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 29/53] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:44 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1295 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:44.492617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:44.493416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:44.502914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:44.503614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:44.515869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:44.516623 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:44.517105 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:44.517551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:44.693124 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:44.696864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:44.710222 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:44.710734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:44.713846 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:44.714653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:44.715261 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:44.716095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:44.959725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:44.974688 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-684f96a0-a3c7-48ea-ba52-1f37339b5c8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1272 microversion: 2.1 time: 0.485672 Sep 01 09:10:44.975631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 25/54] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:44 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1272 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:44.995174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:44.996442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:45.012221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:45.014657 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:45.016937 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:45.017649 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:45.019295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:45.021433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:45.028656 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:45.038551 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d27e73ac-aa81-491b-838f-21579a952021 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.353330 Sep 01 09:10:45.062541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 30/55] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:44 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:45.449993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:45.455541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:45.646183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:45.646183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:45.646183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:45.646183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:45.648104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:45.648104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:45.683582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:45.686196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:45.697278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:45.701245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8071ec94-b56a-496a-9c0c-b09ebf9e1853 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.723761 Sep 01 09:10:45.702760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:45.705816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-59ed7b39-14df-4018-a94c-482741fb0e03 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1285 microversion: 2.20 time: 0.258123 Sep 01 09:10:45.706328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 26/56] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:44 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:45.706488 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 31/57] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:45 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1285 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:10:45.717862 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:45.731223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:45.731223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:45.731223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:45.731223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:45.732073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:45.732073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:45.732073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:45.927865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-aa033155-9b37-4cea-b4db-009d4efedfba req-1ecf5baf-1c18-41d3-a462-09f2f7c5d2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c3385c-4154-40a0-bebe-a0f7be2dcc9b", "tag": "6445032a-1aa0-485e-8a04-f0d6555b85e8"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:45.943373 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:46.006647 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f542ab6e-8c60-442a-967c-5cfd715a8194 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1295 microversion: 2.1 time: 0.262762 Sep 01 09:10:46.006647 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 27/58] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:45 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1295 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:46.007743 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-aa033155-9b37-4cea-b4db-009d4efedfba req-1ecf5baf-1c18-41d3-a462-09f2f7c5d2e8 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.007743 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-aa033155-9b37-4cea-b4db-009d4efedfba req-1ecf5baf-1c18-41d3-a462-09f2f7c5d2e8 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.007743 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-aa033155-9b37-4cea-b4db-009d4efedfba req-1ecf5baf-1c18-41d3-a462-09f2f7c5d2e8 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.008004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:46.008004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:46.032588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.033089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.035710 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.036474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.036943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.037377 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.064259 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-aa033155-9b37-4cea-b4db-009d4efedfba req-1ecf5baf-1c18-41d3-a462-09f2f7c5d2e8 service nova] Creating event network-changed:6445032a-1aa0-485e-8a04-f0d6555b85e8 for instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b on hv-cinder-82002 Sep 01 09:10:46.075240 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-aa033155-9b37-4cea-b4db-009d4efedfba req-1ecf5baf-1c18-41d3-a462-09f2f7c5d2e8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121063) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 09:10:46.079510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-aa033155-9b37-4cea-b4db-009d4efedfba req-1ecf5baf-1c18-41d3-a462-09f2f7c5d2e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121063) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 09:10:46.080854 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.081477 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.082106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.084164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.088561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.089165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.130774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.compute.rpcapi [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 09:10:46.133953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] Releasing lock "compute-rpcapi-router" {{(pid=121063) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 09:10:46.178118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1a2f0ac4-8beb-4916-8134-a050190e36cc None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249575 Sep 01 09:10:46.178118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 32/59] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:46.186643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:46.187878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:46.222203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.223134 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.225206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.230083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.231251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.232179 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.310738 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:46.319673 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b8f3a5ca-d808-465f-8ddc-ae093e94f029 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1278 microversion: 2.1 time: 0.322404 Sep 01 09:10:46.331910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 28/60] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:45 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:46.728465 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:46.734917 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:46.743247 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.744057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.744739 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:46.746975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:46.750365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:46.752208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.028778 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:47.040837 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1d67eebe-aca6-45f1-85da-75cb7e91d8ba tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.864638 Sep 01 09:10:47.041714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 33/61] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:46 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:47.056292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:47.057118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:47.074453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:47.079088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:47.079769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.080829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:47.083597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:47.084379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.132445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:47.407717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:47.419257 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-901132fa-83d0-4450-bbb6-e1f74cb126ba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.697941 Sep 01 09:10:47.434581 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 29/62] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:46 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:47.449064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:47.463578 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:47.467251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:47.471912 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c09fcbee-32a9-4ce6-8cfe-553beb2a0abd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1333 microversion: 2.20 time: 0.426475 Sep 01 09:10:47.476492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 34/63] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:47 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1333 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:47.487365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:47.488369 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:47.511552 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:47.513538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:47.516057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.516952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:47.519870 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:47.521751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.641410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-d8157fae-d9ac-4879-bac6-a7ab117c063e req-cbc8d1ab-07e6-4086-b2bf-7f2d794585b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af02f0cb-1acf-48dd-8868-42cd5ebfff97", "tag": "3e896214-f87a-4a12-8bad-a6d953a69c92"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:47.650612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:47.671118 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-d8157fae-d9ac-4879-bac6-a7ab117c063e req-cbc8d1ab-07e6-4086-b2bf-7f2d794585b6 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:47.671871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-d8157fae-d9ac-4879-bac6-a7ab117c063e req-cbc8d1ab-07e6-4086-b2bf-7f2d794585b6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:47.672659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-d8157fae-d9ac-4879-bac6-a7ab117c063e req-cbc8d1ab-07e6-4086-b2bf-7f2d794585b6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.734857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-d8157fae-d9ac-4879-bac6-a7ab117c063e req-cbc8d1ab-07e6-4086-b2bf-7f2d794585b6 service nova] Creating event network-changed:3e896214-f87a-4a12-8bad-a6d953a69c92 for instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 on hv-cinder-82002 Sep 01 09:10:47.734857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-d8157fae-d9ac-4879-bac6-a7ab117c063e req-cbc8d1ab-07e6-4086-b2bf-7f2d794585b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285871 Sep 01 09:10:47.734857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 30/64] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:47.734857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:47.744702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:47.766499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:47.766499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:47.766499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.766499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:47.767421 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:47.767421 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:47.767610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:47.777909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-af657d2f-c4b6-4f16-87df-5dc668a83d61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1295 microversion: 2.1 time: 0.302088 Sep 01 09:10:47.780133 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 35/65] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:47 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1295 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:47.969289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:47.982887 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c86c0c95-3ca4-4db0-970b-6f7d59feedd5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1278 microversion: 2.1 time: 0.256929 Sep 01 09:10:48.022977 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 31/66] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:47 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:48.065966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:48.066710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:48.074097 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.076054 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.076508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.077372 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.077839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.078265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.444466 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:48.445501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:48.459821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.460708 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.461610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.464905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.466008 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.466711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.669106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:48.677493 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-85a081a0-fdb1-4010-a51a-315afc668e28 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.615280 Sep 01 09:10:48.695446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 36/67] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:48 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:48.720427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:48.723843 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:48.737698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.738412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.741846 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.742577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.743034 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.743479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.882378 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:48.891438 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:48.893261 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:48.894745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-95ab69e2-cfaa-4089-aa04-c7988e2290b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1341 microversion: 2.20 time: 0.198065 Sep 01 09:10:48.895497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 37/68] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:48 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:48.927437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:48.937149 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:48.937417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:48.943580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-78c35553-5f42-49bb-8407-1034b0d61c2b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.505903 Sep 01 09:10:48.953453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.953927 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.954354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.955051 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:48.955526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:48.955944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:48.960146 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 32/69] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:48 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:49.004859 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:49.005892 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:49.012174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.012894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.014027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.014757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.015390 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.016519 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.091070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:49.099274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-32648f5a-4348-4702-b1a5-66fd3241eb96 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1278 microversion: 2.1 time: 0.098930 Sep 01 09:10:49.112467 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 33/70] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:48 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:49.126312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:49.134682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6ae6874d-7637-4c73-aa16-e3c21ebb63b6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.237950 Sep 01 09:10:49.135305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 38/71] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:48 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:49.699485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:49.704785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:49.711443 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.711999 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.712617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.713317 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.713764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.714185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.848122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:49.851329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:49.855991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7efa3101-dcd0-4ca6-8d5e-5f34a9e0ae9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.161093 Sep 01 09:10:49.856571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 34/72] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:49 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:49.920313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:49.920933 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:49.927131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.927745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.928289 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.929042 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.929661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.930087 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.971747 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:49.972687 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:49.978680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.979882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.979882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.980337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:49.980795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:49.981226 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:49.995510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:50.004286 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:50.013249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:50.013249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e419d109-a3f8-4e68-bb9c-e7da44374608 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1351 microversion: 2.20 time: 0.090707 Sep 01 09:10:50.013249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 39/73] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:49 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:50.113682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:50.121909 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fa144c28-7132-4ef3-9a32-1bc93750e5f2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.155794 Sep 01 09:10:50.125162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:50.125318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 35/74] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:49 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:10:50.126892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:50.133798 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:50.134382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:50.134949 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:50.135869 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:50.139338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:50.139872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:50.155480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:50.156763 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:50.164449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:50.165108 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:50.165891 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:50.167206 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:50.167884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:50.168512 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:50.317256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:50.329098 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fae17bb6-2631-4fd2-bf7c-37e69bd217d7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.209723 Sep 01 09:10:50.329098 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 40/75] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:50 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:50.329458 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:50.337010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6c04881b-eac5-4b65-9fab-4299f7e4d788 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.186365 Sep 01 09:10:50.337698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 36/76] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:50 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:10:50.877071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:50.877726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:50.883816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:50.884302 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:50.884733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:50.885603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:50.886385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:50.887175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.027501 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:51.031603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:51.032214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:51.036493 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a7576a6a-39f0-4bf5-8a46-52a027ea541b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.163340 Sep 01 09:10:51.037233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 41/77] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:50 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:51.042132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.042787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.043274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.043986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.044530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.045266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.106565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:51.115187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:51.116723 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:51.117818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f5be0811-89d9-4294-a148-8c977208859f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1351 microversion: 2.20 time: 0.090844 Sep 01 09:10:51.118378 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 37/78] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:51 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:10:51.144209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:51.144945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:51.151090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.151612 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.152050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.152744 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.153208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.153638 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.290992 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:51.298815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-98e9a33e-5a32-4840-bff6-0792a44b298d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.158560 Sep 01 09:10:51.299430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 42/79] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:51 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:51.349037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:51.349669 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:51.358460 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:51.359068 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:51.365159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.365648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.366081 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.366755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.366976 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.367291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.367776 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.368072 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.368202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.369025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:51.369622 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:51.370183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:51.521124 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:51.529683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e6f8997d-44b9-4c44-bad3-6aac77383e61 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.175016 Sep 01 09:10:51.531312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 43/80] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:51 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:51.535761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:51.544123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ef55df8f-2199-4bf5-81e7-1f336c6dbfb9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.200061 Sep 01 09:10:51.545270 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 38/81] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:51 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:52.057442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:52.058135 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:52.064302 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.067789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.067789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.067789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.067789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.068113 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.139763 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:52.140653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:52.148730 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.149488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.152745 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.153513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.155637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.156160 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.219516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:52.230295 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-02607c19-4137-4a38-9e18-b4cd270dd4b5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.176719 Sep 01 09:10:52.233025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:52.236934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 44/82] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:52 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:52.251148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:52.252779 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:52.253830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-70921aa8-e6a2-477b-9be0-adf415089bc7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1351 microversion: 2.20 time: 0.117809 Sep 01 09:10:52.255533 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 39/83] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:52 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:10:52.319404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:52.320091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:52.326928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.327531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.328055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.328810 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.329340 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.329838 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.465930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:52.474475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ccc2a087-7f15-4879-96a6-29ec5bcbc820 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.159040 Sep 01 09:10:52.475054 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 45/84] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:52 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:52.551158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:52.552358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:52.559613 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.560223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.560743 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.561949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.562655 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.563265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.569661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:52.570409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:52.579379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.580032 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.580576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.581979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:52.582583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:52.583148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:52.722014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:52.726031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:52.730943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e7850be7-e665-49ff-9205-3fb0400a5a57 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.184284 Sep 01 09:10:52.731944 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 40/85] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:52 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:52.734993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6f0033d7-9da4-4409-a0e8-71fe0ccd9d81 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.172220 Sep 01 09:10:52.735667 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 46/86] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:52 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:10:53.251669 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:53.252276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:53.254200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:53.259122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.259617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.260051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.260732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.261183 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.261602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.282421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:53.283216 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:53.285135 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=36 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:53.290186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.292122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.292122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.292122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.292394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.292739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.361060 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:53.367217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:53.368783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:53.369873 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1183dd0b-db85-443a-b1b9-bc17569348c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1351 microversion: 2.20 time: 0.092124 Sep 01 09:10:53.370647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 47/87] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:53 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:53.400947 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:53.409475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8db2a368-ea6a-4f51-b20d-0402bfce7ffb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.162005 Sep 01 09:10:53.410057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 41/88] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:53 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:53.498175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:53.498175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:53.508395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.508882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.509354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.510120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.510574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.510993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.686620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:53.695266 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d733e4a4-7756-4b05-9bce-20bad6cf393c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.203585 Sep 01 09:10:53.695647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 48/89] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:53 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:53.761753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:53.768997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:53.772312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:53.773040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:53.776148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.776848 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.777286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.778014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.778461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.779065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.779262 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.781534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.781991 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.782847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:53.783341 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:53.783768 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:53.972886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:53.990931 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-03dd0b33-e5e1-443e-8cf9-b8f3370ee0d4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.234642 Sep 01 09:10:53.991450 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 42/90] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:53 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:54.015081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:54.023272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0b71cf17-6412-4a26-8e20-84c1a4a5eda3 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.259982 Sep 01 09:10:54.024447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 49/91] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:53 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:54.393050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:54.393677 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:54.395520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=28 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:54.400212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:54.400694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:54.401135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:54.401849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:54.402302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:54.402732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:54.430420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:54.431125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:54.437875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:54.440864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:54.440864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:54.440864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:54.440864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:54.441213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:54.471366 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:54.476944 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:54.478398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:54.479527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c22b713b-7c8c-492b-a76d-fd3d5e6e3591 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1351 microversion: 2.20 time: 0.091092 Sep 01 09:10:54.480096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 43/92] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:54 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:54.574191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:54.582081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9dcfc50a-7ffa-433a-8009-e969aa094d74 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.155463 Sep 01 09:10:54.583131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 50/93] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:54 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:54.718142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:54.718759 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:54.724968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:54.725458 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:54.725920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:54.726655 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:54.727128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:54.727569 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:54.857387 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:54.865184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64d791d0-93d7-4f9d-afba-810735b2baba tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.151431 Sep 01 09:10:54.865877 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 44/94] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:54 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:55.012065 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:55.012604 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:55.019073 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.019754 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.020089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.020805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.021258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.021681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.025579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:55.046163 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:55.046907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:55.053570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.054205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.054731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.055668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.056754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.157595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:55.165821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c7e42e53-f539-4576-8a93-f7d61a073c50 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.157523 Sep 01 09:10:55.166411 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 51/95] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:55 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:55.187852 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:55.195556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0ebc5dc9-e84d-4d56-ac41-3876787bcb56 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.153782 Sep 01 09:10:55.196215 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 45/96] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:55 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:10:55.501917 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:55.503135 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:55.509687 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.510422 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.511180 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.512110 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.512835 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.514998 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.589534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:55.598355 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:55.599853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:55.600958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1728f921-7e9b-4d58-9a7a-a2c89f05f1b2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1351 microversion: 2.20 time: 0.103106 Sep 01 09:10:55.616031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 52/97] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:55 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:55.616227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:55.616227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:55.616227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.616227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.616921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.616921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.616921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.616921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.885909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:55.886528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:55.893905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.894394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.895151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.895961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:55.896639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:55.897131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:55.901743 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:55.909349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-00ee71c8-656f-41b8-8d26-8efa94b6b84f tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.309491 Sep 01 09:10:55.919897 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 46/98] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:55 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:56.120803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=10 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:56.187437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:56.188205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:56.195276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.195870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.196387 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.197212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.197767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.198265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.429679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:56.444964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8e7e0424-970c-4aa3-9452-26ea731f2984 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.562847 Sep 01 09:10:56.458627 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 53/99] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:55 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:56.463410 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:56.464177 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:56.480781 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.481854 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.483079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.484295 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.486743 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.487461 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.548970 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:56.596731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b1a1bfc9-2ea1-4670-928d-1557d9b591ef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.414554 Sep 01 09:10:56.602292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 47/100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:56 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:56.630085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:56.631483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:56.647175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.647896 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.648597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.649522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.650125 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.651310 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.770967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:56.783268 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:56.791276 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f011bdfe-25ee-4f76-b758-5d5e87155a64 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.335298 Sep 01 09:10:56.794402 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:56.795887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 54/101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:56 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:56.805026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:56.808865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-39802231-31c8-448f-b4bd-e2c25c731821 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1339 microversion: 2.20 time: 0.182520 Sep 01 09:10:56.809556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 48/102] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:56 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:10:56.881606 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-9e5dcf86-6a3a-462c-8dbe-41eb00ad80b0 req-2656af9d-e80d-4be2-a637-447c260d3d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be4ee16-c20b-4744-9bb7-94a9afbb5415", "tag": "acaff261-2863-4f8a-85c5-32280f295ab4"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:56.891565 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9e5dcf86-6a3a-462c-8dbe-41eb00ad80b0 req-2656af9d-e80d-4be2-a637-447c260d3d3a service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.892243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9e5dcf86-6a3a-462c-8dbe-41eb00ad80b0 req-2656af9d-e80d-4be2-a637-447c260d3d3a service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.892867 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9e5dcf86-6a3a-462c-8dbe-41eb00ad80b0 req-2656af9d-e80d-4be2-a637-447c260d3d3a service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.905642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-9e5dcf86-6a3a-462c-8dbe-41eb00ad80b0 req-2656af9d-e80d-4be2-a637-447c260d3d3a service nova] Creating event network-changed:acaff261-2863-4f8a-85c5-32280f295ab4 for instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 on hv-cinder-82002 Sep 01 09:10:56.911184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-9e5dcf86-6a3a-462c-8dbe-41eb00ad80b0 req-2656af9d-e80d-4be2-a637-447c260d3d3a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034235 Sep 01 09:10:56.912675 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 55/103] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:10:56.941492 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:56.942070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:56.950303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.956089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.956089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:56.956089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:56.956089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:56.956511 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.022149 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-4a9ef34d-7bc3-42c0-9599-1bb67195a67d req-8073dd5a-af82-459d-bfde-cc1d15a2c616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20653d8d-9ed3-47c2-baa8-63e3ba1725bf", "tag": "c121e215-1c32-40c0-8a1e-fd1bc8f17a7d"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:10:57.033126 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-4a9ef34d-7bc3-42c0-9599-1bb67195a67d req-8073dd5a-af82-459d-bfde-cc1d15a2c616 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.034506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-4a9ef34d-7bc3-42c0-9599-1bb67195a67d req-8073dd5a-af82-459d-bfde-cc1d15a2c616 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.035427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-4a9ef34d-7bc3-42c0-9599-1bb67195a67d req-8073dd5a-af82-459d-bfde-cc1d15a2c616 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.052589 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-4a9ef34d-7bc3-42c0-9599-1bb67195a67d req-8073dd5a-af82-459d-bfde-cc1d15a2c616 service nova] Creating event network-changed:c121e215-1c32-40c0-8a1e-fd1bc8f17a7d for instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf on hv-cinder-82002 Sep 01 09:10:57.059726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-4a9ef34d-7bc3-42c0-9599-1bb67195a67d req-8073dd5a-af82-459d-bfde-cc1d15a2c616 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041747 Sep 01 09:10:57.063210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 56/104] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:10:57.177610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:57.191598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f54fb055-f4dd-4e27-9e27-87e9a72fcdda tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.253881 Sep 01 09:10:57.196169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 49/105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:56 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:57.467582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:57.468800 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:57.478866 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.479384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.479953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.480730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.481424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.482952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.627782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:57.628868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:57.635384 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.635969 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.636446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.637421 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.637999 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.639085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.643783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:57.651401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7448dd3b-25af-4a28-8f59-22dd888e7cfa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.189026 Sep 01 09:10:57.653766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 57/106] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:57 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:57.785205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:57.793528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-151a0a81-5ccb-4d95-8dea-f7da0021b103 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.170479 Sep 01 09:10:57.806315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 50/107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:57 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:10:57.818882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:57.819572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:57.827361 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.831847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.831847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.831847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.831847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.832478 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.833660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:57.836063 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:57.842524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.843063 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.855040 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.855844 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:57.856515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:57.858287 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:57.879786 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:10:58.007394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:58.017337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:58.019204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:58.020601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b0fb933d-036d-4faf-a817-2e1f39ab28b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.192843 Sep 01 09:10:58.021236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 51/108] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:57 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:58.038312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:58.046436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-16b9800d-3a68-4fa4-a2eb-03112ed04065 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.233493 Sep 01 09:10:58.047000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 58/109] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:57 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:58.212632 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:58.213268 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:58.219272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:58.219753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:58.220215 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:58.220899 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:58.221347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:58.221767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:58.351792 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:58.359938 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1fea1dfa-cd84-4461-92f6-8a3b59ce704a tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.151349 Sep 01 09:10:58.360509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 52/110] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:58 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:58.673591 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:58.674154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:58.680089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:58.680572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:58.681014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:58.681728 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:58.682217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:58.682633 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:58.818236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:58.818865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:58.825449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:58.825926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:58.827029 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:58.827029 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:58.827725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:58.828334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:58.828761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:58.833466 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b9f87a2a-4087-484f-bba8-f38b68aaa26d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.164446 Sep 01 09:10:58.834040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 59/111] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:58 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:58.967135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:58.974534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-08b94d24-5d5a-47c6-b09d-4bdb3fbcabe2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.162401 Sep 01 09:10:58.975514 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 53/112] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:58 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:59.047973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:59.049071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:59.061709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.064530 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.064530 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:59.064530 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.065323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.066088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:59.068235 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:59.069012 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:59.078551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.079267 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.079700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:59.080566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.081022 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.081443 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:59.239360 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:59.247549 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1dc95028-9aa8-417d-922e-868c9699ba92 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.184354 Sep 01 09:10:59.249044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 54/113] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:59 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:59.293913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:59.302310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:59.303792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:59.305030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1b1ea2bf-1089-4de5-beb1-010016d7630d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.264720 Sep 01 09:10:59.305753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 60/114] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:10:59 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:10:59.380772 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:59.381384 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:59.387422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.387902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.389160 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:59.390265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.390715 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.391167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:59.559761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:10:59.569288 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6de056a5-5e77-42fa-bc3d-4e843e5a1a9c tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.192440 Sep 01 09:10:59.569881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 55/115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:59 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:10:59.854688 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:10:59.855224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:10:59.862580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.863187 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.863630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:10:59.864349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:10:59.864807 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:10:59.865228 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.004573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:00.004573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:00.012163 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.012816 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.013082 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:00.013752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.014807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.015516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.016828 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.022337 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-95a45c62-f00f-416f-8e04-c2a1eb16f051 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.172295 Sep 01 09:11:00.027868 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 61/116] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:59 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:00.159952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:00.167984 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dfd71fab-0321-4727-a599-24c9e240d60b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.172884 Sep 01 09:11:00.168546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 56/117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:10:59 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:00.275030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:00.275030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:00.277727 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.278291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.278794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.279759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.280293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.280806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.331275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:00.332290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:00.340072 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.346194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.346663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.347449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.348018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.348334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.437312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:00.445544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cbf5b40a-2449-48b4-a399-fe82b6b29e37 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.178988 Sep 01 09:11:00.447423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 62/118] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:00 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:00.509159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:00.518045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:00.519527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:00.523023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4e9805fe-eccb-435b-a4d2-e5285df28466 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.195617 Sep 01 09:11:00.523023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 57/119] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:00 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:00.592593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:00.593201 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:00.599208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.599693 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.600125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.600811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:00.601260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:00.601679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:00.775831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:00.783487 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f8f086b1-370d-4b3a-8e5c-6f8a0de5964b tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.194760 Sep 01 09:11:00.784057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 63/120] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:00 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:01.046139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:01.046845 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:01.053939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.054745 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.055434 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.056375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.057037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.057556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.190813 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:01.191704 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:01.198683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.199562 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.200304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.201811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.202665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.203378 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.237800 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:01.245605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e3e0f95a-5310-4c49-b547-d6e2ca0a713b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.205469 Sep 01 09:11:01.246181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 58/121] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:01 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:01.468346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:01.468951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:01.474856 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.475571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.476000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.476956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.477432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.478027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.489063 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:01.500278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d55a52d8-41fc-4a52-9a4b-2e52d3ee74a6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.314904 Sep 01 09:11:01.501273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 64/122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:01 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:01.543055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:01.543736 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:01.552526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.553650 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.554294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.555522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.557525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.558118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.671465 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:01.680473 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0477c0df-2e70-4d9b-8d82-e1a2a2da561b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.216150 Sep 01 09:11:01.694002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 59/123] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:01 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:01.807123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:01.807770 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:01.808050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:01.814020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.814931 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.815543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.816246 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:01.816939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:01.817513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:01.817913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:01.823072 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:01.825085 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-18b6c02e-dd2a-4d10-9950-bdceb6bafa9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.286342 Sep 01 09:11:01.826055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 65/124] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:01 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:01.993668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:02.003022 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e0b8e5c1-4488-44bf-8b2f-f243dc986ab5 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.200238 Sep 01 09:11:02.003695 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 60/125] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:01 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:02.267036 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:02.271828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:02.274053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.274567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.275004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.275731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.276188 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.276622 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.437727 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:02.450502 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7fe411c6-11f0-4e90-a31b-52e09c1d8c5d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.185236 Sep 01 09:11:02.451423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 66/126] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:02 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:02.523256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:02.524976 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:02.534214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.541987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.541987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.541987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.541987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.542428 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.702895 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:02.704429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:02.713975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:02.714502 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.715382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.716011 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.717832 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.718501 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.719131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.752140 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:02.760822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-224e2bfb-fb94-4776-8d06-9ed53d489a21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.242656 Sep 01 09:11:02.780111 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 61/127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:02 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:02.848359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:02.848893 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:02.854986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.855494 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.856392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.856609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:02.857130 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:02.858205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:02.883231 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:02.898362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-145f383c-2e6d-4ef5-a559-baf20c872014 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.200382 Sep 01 09:11:02.901694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 67/128] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:02 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:03.018268 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:03.026432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:03.027377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:03.028201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:03.030137 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:03.031495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-191a85e9-2ee1-41cb-a27b-e7236274f7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.186930 Sep 01 09:11:03.032435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 62/129] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:02 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:11:03.034951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.035657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.036143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.036847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.037470 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.037911 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.177571 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:03.185277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b9b97a52-b289-4626-acc6-4b4475dfe0f9 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.164881 Sep 01 09:11:03.186498 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 68/130] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:03 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:03.474203 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:03.475735 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:03.497602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.498250 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.498884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.499926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.501172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.502628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.669286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:03.679006 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7cd53c95-81d1-4032-b21b-0f5f7fe7c41a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.210908 Sep 01 09:11:03.691902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 63/131] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:03 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:03.783328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:03.784000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:03.791270 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.792118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.792734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.793564 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.794183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.794641 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.799323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:03.925916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:03.926817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:03.934049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.935019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.945272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.945272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:03.945815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:03.946433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:03.947539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:03.962832 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c3851c0c-6a18-48cd-a7db-ef568e1e2535 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.184795 Sep 01 09:11:03.978137 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 69/132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:03 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:04.070057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:04.070057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:04.070057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:04.070057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:04.070665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:04.070665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:04.070665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:04.070665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:04.537462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:04.545385 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:04.555357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:04.557105 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:04.572043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fd90b797-6ca8-43ff-a380-215e2de289a7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.645532 Sep 01 09:11:04.573856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c700b810-5f15-4b1c-b3c3-a1c55245659a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.506539 Sep 01 09:11:04.574609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 64/133] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:03 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:04.576292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 70/134] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:04 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:04.606440 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:04.608058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:04.628078 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:04.629887 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:04.630364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:04.632993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:04.633518 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:04.636869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:04.845160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-56b7d08d-d202-4578-9d21-bb7c9ebec534 req-90a9fe2d-4e02-4c78-8b3a-1b248b2d1e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64746b2e-3205-48c6-83d4-77230c7226be", "name": "network-vif-plugged", "status": "completed", "tag": "3d27e768-35dd-45bf-b9b7-c2e5c51c8430"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:04.855041 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-56b7d08d-d202-4578-9d21-bb7c9ebec534 req-90a9fe2d-4e02-4c78-8b3a-1b248b2d1e52 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:04.855593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-56b7d08d-d202-4578-9d21-bb7c9ebec534 req-90a9fe2d-4e02-4c78-8b3a-1b248b2d1e52 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:04.856024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-56b7d08d-d202-4578-9d21-bb7c9ebec534 req-90a9fe2d-4e02-4c78-8b3a-1b248b2d1e52 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:04.869466 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-56b7d08d-d202-4578-9d21-bb7c9ebec534 req-90a9fe2d-4e02-4c78-8b3a-1b248b2d1e52 service nova] Creating event network-vif-plugged:3d27e768-35dd-45bf-b9b7-c2e5c51c8430 for instance 64746b2e-3205-48c6-83d4-77230c7226be on hv-cinder-82002 Sep 01 09:11:04.878181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-56b7d08d-d202-4578-9d21-bb7c9ebec534 req-90a9fe2d-4e02-4c78-8b3a-1b248b2d1e52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299900 Sep 01 09:11:04.879218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 71/135] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:04.886186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:04.887270 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:04.894550 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:04.895423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:04.896477 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:04.897424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:04.898143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:04.898777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:05.278917 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:05.291410 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-75462598-785e-4966-953c-913236d57168 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.410438 Sep 01 09:11:05.291949 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 72/136] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:04 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:05.309731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:05.310589 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:05.317542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:05.318031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:05.318456 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:05.319355 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:05.319976 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:05.320653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:05.489306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:05.497185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-89628ab7-7099-4d1f-9d7e-2c7f57299104 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.920089 Sep 01 09:11:05.509318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 65/137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:04 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:05.610551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:05.612216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:05.624439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:05.624995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:05.625502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:05.626294 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:05.626990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:05.628671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:05.795999 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:05.811256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0bd28ea6-0331-456f-aba5-01fc9c32e517 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.507567 Sep 01 09:11:05.818945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 73/138] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:05 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:05.828957 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:05.830240 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:05.851285 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:05.854184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:05.856846 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:05.860223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:05.862792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:05.863516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.126308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:06.136662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-55cd9184-2d14-46af-9086-a6bd4309b816 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.530570 Sep 01 09:11:06.142157 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 66/139] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:05 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:06.236279 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:06.264172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:06.273394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:06.276431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1ef718e9-e5a7-414f-aec4-58eebec13b40 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.456321 Sep 01 09:11:06.277985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 74/140] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:05 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:06.314152 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:06.314900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:06.339559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.340086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.340995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.342267 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.346432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.346909 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.530551 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:06.531288 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:06.537851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.538635 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.539441 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.540604 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.541281 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.541991 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.557952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:06.572077 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-08f9d02c-f615-4611-9727-93829f61eeb6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.263232 Sep 01 09:11:06.573573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 67/141] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:06 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:06.604474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-8961e645-5680-4d21-8aae-aef8eff505e4 req-2b2cc3a1-c625-4281-9027-839439bfe8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfa76cf-89f5-4112-a5ae-859e051bbe0d", "tag": "8bfe0a67-ded1-411e-bbbd-beb319ed33d0"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:06.623035 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-8961e645-5680-4d21-8aae-aef8eff505e4 req-2b2cc3a1-c625-4281-9027-839439bfe8ae service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.626553 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-8961e645-5680-4d21-8aae-aef8eff505e4 req-2b2cc3a1-c625-4281-9027-839439bfe8ae service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.627023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-8961e645-5680-4d21-8aae-aef8eff505e4 req-2b2cc3a1-c625-4281-9027-839439bfe8ae service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.640911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:06.648997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-8961e645-5680-4d21-8aae-aef8eff505e4 req-2b2cc3a1-c625-4281-9027-839439bfe8ae service nova] Creating event network-changed:8bfe0a67-ded1-411e-bbbd-beb319ed33d0 for instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d on hv-cinder-82002 Sep 01 09:11:06.655689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-8961e645-5680-4d21-8aae-aef8eff505e4 req-2b2cc3a1-c625-4281-9027-839439bfe8ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057797 Sep 01 09:11:06.657112 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 68/142] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:06.724969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:06.737408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-993eb21d-3d14-4491-baf2-f3a3e5e9d584 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.211375 Sep 01 09:11:06.738020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 75/143] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:06 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:06.837949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:06.838669 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:06.847784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.848268 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.848698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.849439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.849885 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.850301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.894321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-17978a06-c2be-46e4-91fd-52f94de42eae req-f6ddaa2d-336a-45b2-b258-852e5da72fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c3385c-4154-40a0-bebe-a0f7be2dcc9b", "name": "network-vif-plugged", "status": "completed", "tag": "6445032a-1aa0-485e-8a04-f0d6555b85e8"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:06.905174 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-17978a06-c2be-46e4-91fd-52f94de42eae req-f6ddaa2d-336a-45b2-b258-852e5da72fdd service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:06.905908 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-17978a06-c2be-46e4-91fd-52f94de42eae req-f6ddaa2d-336a-45b2-b258-852e5da72fdd service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:06.906397 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-17978a06-c2be-46e4-91fd-52f94de42eae req-f6ddaa2d-336a-45b2-b258-852e5da72fdd service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:06.927828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-17978a06-c2be-46e4-91fd-52f94de42eae req-f6ddaa2d-336a-45b2-b258-852e5da72fdd service nova] Creating event network-vif-plugged:6445032a-1aa0-485e-8a04-f0d6555b85e8 for instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b on hv-cinder-82002 Sep 01 09:11:06.940158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-17978a06-c2be-46e4-91fd-52f94de42eae req-f6ddaa2d-336a-45b2-b258-852e5da72fdd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049371 Sep 01 09:11:06.944326 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 76/144] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:07.165025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:07.166035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:07.175962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.176552 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.177102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.177827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.178371 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.178798 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.189405 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:07.198668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0953f830-070e-42c2-9932-7b9fa3afa151 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.367459 Sep 01 09:11:07.212400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 69/145] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:06 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:07.305205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:07.309920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:07.312859 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.313402 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.313832 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.314517 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.314964 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.315424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.364520 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:07.373078 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7fe1aff5-6fa3-4a2f-8585-6e6ad3d75808 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.212731 Sep 01 09:11:07.374155 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 77/146] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:07 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:07.533993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:07.544683 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:07.545474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:07.546592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5c53eec6-96a8-4736-b77a-a565d75894d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.245218 Sep 01 09:11:07.547277 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 70/147] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:07 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:07.596500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:07.597149 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:07.603008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.603528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.603966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.604728 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.605113 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.605539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.746954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:07.755122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-27b88c62-04d7-457b-a334-f57c1ec0b1d0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.162454 Sep 01 09:11:07.758261 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 78/148] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:07 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:07.758368 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:07.759120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:07.765520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.766014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.766452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.767402 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:07.767950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:07.768681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:07.904906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:07.915927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-54203fa2-ce24-41a9-a3f8-a7ab10c4afe1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.161846 Sep 01 09:11:07.916553 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 71/149] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:07 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:08.222300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:08.222989 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:08.229169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.229739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.230228 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.230910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.231393 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.231819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.362165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:08.370484 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ac396d45-0967-48ea-a322-e9f4a7629ad5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.151554 Sep 01 09:11:08.370791 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 79/150] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:08 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:08.394154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:08.394823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:08.401158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.401630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.402056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.402734 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.403304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.403883 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.531586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:08.539063 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c31d8900-35a8-4388-9ed9-0516830de92f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.148809 Sep 01 09:11:08.539926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 72/151] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:08 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:08.570030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:08.570639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:08.577888 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.578371 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.579979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.579979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.579979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.580429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.707922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:08.716396 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:08.717897 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:08.719019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7508708a-ad25-48b8-8493-6c7941c50d0f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.152888 Sep 01 09:11:08.719632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 80/152] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:08 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:08.775521 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:08.776153 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:08.782226 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.782702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.783159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.783833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.784336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.784762 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.911228 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:08.919352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-03fde8b4-0264-4d20-9b21-cba351719c8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.147565 Sep 01 09:11:08.920627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 73/153] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:08 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:08.937280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:08.937915 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:08.943878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.944357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.944787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.945467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.946162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.946494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.961801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-80e336fa-532d-4a05-968a-dfea3fe8381b req-d72f8fdd-f2bd-4371-91c1-9c20d1e27f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af02f0cb-1acf-48dd-8868-42cd5ebfff97", "name": "network-vif-plugged", "status": "completed", "tag": "3e896214-f87a-4a12-8bad-a6d953a69c92"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:08.973289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-80e336fa-532d-4a05-968a-dfea3fe8381b req-d72f8fdd-f2bd-4371-91c1-9c20d1e27f53 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:08.998907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-80e336fa-532d-4a05-968a-dfea3fe8381b req-d72f8fdd-f2bd-4371-91c1-9c20d1e27f53 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:08.998907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-80e336fa-532d-4a05-968a-dfea3fe8381b req-d72f8fdd-f2bd-4371-91c1-9c20d1e27f53 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:08.998907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-80e336fa-532d-4a05-968a-dfea3fe8381b req-d72f8fdd-f2bd-4371-91c1-9c20d1e27f53 service nova] Creating event network-vif-plugged:3e896214-f87a-4a12-8bad-a6d953a69c92 for instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 on hv-cinder-82002 Sep 01 09:11:08.998907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-80e336fa-532d-4a05-968a-dfea3fe8381b req-d72f8fdd-f2bd-4371-91c1-9c20d1e27f53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038618 Sep 01 09:11:08.998907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 74/154] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:11:09.081773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:09.089352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-86430e40-a32e-46da-86fc-2e42d8c45280 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1314 microversion: 2.1 time: 0.156842 Sep 01 09:11:09.089917 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 81/155] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:08 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:09.390542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:09.391293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:09.397830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.398310 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.398741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.399448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.399903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.400324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.534622 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:09.544447 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-54f693bd-f973-456e-9153-97cf5b626f98 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.156776 Sep 01 09:11:09.544447 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 75/156] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:09 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:09.564592 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:09.564592 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:09.566929 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.567611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.568049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.568737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.569186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.569603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.705398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:09.713609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-84623bee-e662-4118-810d-680a00a74320 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.157193 Sep 01 09:11:09.714190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 82/157] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:09 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:09.741797 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:09.742410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:09.750711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.751227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.751666 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.752454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.752899 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.753490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.941158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:09.941996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:09.951964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.951964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.951964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.951964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:09.952357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:09.952357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:09.978139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:09.987274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:09.988745 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:09.989852 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c154d80c-4b7e-459b-9d96-1ad2d62541f9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.251950 Sep 01 09:11:09.990407 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 76/158] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:09 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:11:10.093462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:10.101024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f71f7084-f42d-486d-b069-213762f91316 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.164208 Sep 01 09:11:10.101586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 83/159] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:09 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:10.109997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:10.110633 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:10.116787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:10.117274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:10.117713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:10.118401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:10.118868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:10.119328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:10.247027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:10.255204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ff500c1e-3986-4d92-b2c7-a53269275a11 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1501 microversion: 2.1 time: 0.149408 Sep 01 09:11:10.261654 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 77/160] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:10 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:10.566526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:10.567163 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:10.573266 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:10.574423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:10.575282 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:10.576157 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:10.576594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:10.577021 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:10.706081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:10.714237 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0357d6bf-1797-4eab-9a52-1df2ff5dd7c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.152288 Sep 01 09:11:10.714732 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 84/161] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:10 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:10.733572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:10.734229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:10.740290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:10.740775 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:10.741210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:10.741890 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:10.742335 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:10.742751 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:10.877399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:10.886468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ae88ae60-aa77-4ec3-8734-028a4e0359ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.156558 Sep 01 09:11:10.887064 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 78/162] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:10 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:11.012906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:11.013518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:11.020089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.020707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.021072 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:11.021785 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.022224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.022648 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:11.121727 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:11.121727 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:11.129221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.129697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.130123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:11.130857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.131350 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.131794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:11.246230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:11.262390 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:11.265501 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:11.270404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a6a200d3-273f-482b-b024-ebce02aa45ba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.261173 Sep 01 09:11:11.272617 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 85/163] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:11 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:11.316347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:11.324640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f0c1ed65-b7eb-4031-a6ac-d8485555355f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.207243 Sep 01 09:11:11.325601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 79/164] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:11 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:11.735906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:11.736534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:11.742931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.750152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.750152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:11.750152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.750152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.751064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:11.891936 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:11.910200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:11.911194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:11.916698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:11.919548 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-772efb83-6599-49f9-9b51-c7614100f962 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.188111 Sep 01 09:11:11.920631 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 86/165] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:11 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:11.921154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.921729 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.922224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:11.923070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:11.923555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:11.923978 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:12.168715 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:12.176624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f2151fc5-1e4b-4b5e-946e-90188155a048 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.271127 Sep 01 09:11:12.177206 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 80/166] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:11 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:12.297952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:12.298570 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:12.304814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:12.305299 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:12.306970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:12.306970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:12.306970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:12.307412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:12.315092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:12.345046 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:12.345655 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:12.352103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:12.352637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:12.353074 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:12.353768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:12.354220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:12.354640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:12.450241 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:12.463789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:12.465714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:12.467238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-bb159ba3-6fe7-4c77-94f4-60b9cc85c243 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.173203 Sep 01 09:11:12.468738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 87/167] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:12 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:12.687823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:12.695940 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bf6f9647-7a86-41b6-b3ad-72d37006a0da tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.354378 Sep 01 09:11:12.696445 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 81/168] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:12 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:12.941741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:12.942360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:12.951038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:12.955425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:12.958614 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:12.959580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:12.960231 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:12.960666 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.117866 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:13.126642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ba50489d-5244-4f85-8a01-83ed4c7ba713 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.189855 Sep 01 09:11:13.127164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 88/169] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:12 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:13.197619 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:13.198804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:13.206193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.206713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.211643 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.211643 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.211643 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.211643 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.342223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d77723cf-1e78-47f5-b530-02fc269b5230"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:13.344954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:13.345123 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:13.354129 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ceb74813-0570-40e9-a6b0-ff9b237b2761 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.160414 Sep 01 09:11:13.354896 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 82/170] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:13 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:13.360286 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.361042 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.361603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.362384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.362941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.363491 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.491394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:13.492013 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:13.498165 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.498657 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.499095 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.504956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.504956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.504956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.638133 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:13.647348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:13.649067 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:13.650286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3e9e18a2-c638-43fe-8b41-12658e934047 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.163808 Sep 01 09:11:13.650861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 83/171] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:13 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:13.715980 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:13.716602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:13.724227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.724782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.725219 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.725916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:13.726369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:13.726795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:13.853504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:13.861915 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-75ab84f2-e360-4048-88ec-b7a444f92c71 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.149691 Sep 01 09:11:13.862487 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 84/172] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:13 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:14.149120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:14.149120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:14.155626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.157009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.157526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.158468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.160255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.160815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.304487 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:14.312986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8db96442-bae3-4e9e-8e4f-8d731a47f96e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.169451 Sep 01 09:11:14.313554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 85/173] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:14 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:14.318143 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-58574e82-b42e-4c18-aa44-8dccf56d4b3c req-3a90d55b-3d88-4b82-951d-c72fb22a175f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be4ee16-c20b-4744-9bb7-94a9afbb5415", "name": "network-vif-plugged", "status": "completed", "tag": "acaff261-2863-4f8a-85c5-32280f295ab4"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:14.327734 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-58574e82-b42e-4c18-aa44-8dccf56d4b3c req-3a90d55b-3d88-4b82-951d-c72fb22a175f service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.328238 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-58574e82-b42e-4c18-aa44-8dccf56d4b3c req-3a90d55b-3d88-4b82-951d-c72fb22a175f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.328663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-58574e82-b42e-4c18-aa44-8dccf56d4b3c req-3a90d55b-3d88-4b82-951d-c72fb22a175f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.332489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:14.339937 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-58574e82-b42e-4c18-aa44-8dccf56d4b3c req-3a90d55b-3d88-4b82-951d-c72fb22a175f service nova] Creating event network-vif-plugged:acaff261-2863-4f8a-85c5-32280f295ab4 for instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 on hv-cinder-82002 Sep 01 09:11:14.345350 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-58574e82-b42e-4c18-aa44-8dccf56d4b3c req-3a90d55b-3d88-4b82-951d-c72fb22a175f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030712 Sep 01 09:11:14.345943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 86/174] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:14.385310 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:14.386001 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:14.394111 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.394598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.395337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.396034 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.396645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.397077 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.584648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:14.592417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-092887fb-43c3-41e1-af42-5a98c244b64c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.213394 Sep 01 09:11:14.594072 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 87/175] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:14 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:14.674501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:14.675035 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:14.681706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.682205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.683021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.684373 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.684835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.685262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.867416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:14.881291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:14.885969 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:14.887187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-53b4803c-27b8-473d-8622-c27a7d24d066 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.217283 Sep 01 09:11:14.887733 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 88/176] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:14 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:11:14.895127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:14.900240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:14.913366 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.917712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.919872 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:14.925311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:14.925311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:14.925311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:15.095488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:15.103566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-123230d9-de93-443d-abe4-e1ed88cce5d5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1366 microversion: 2.1 time: 0.212396 Sep 01 09:11:15.104154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 89/177] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:14 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:15.334354 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:15.335768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:15.342185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:15.342673 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:15.343186 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:15.343988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:15.344448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:15.344880 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:15.587724 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:15.597992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d1cc6777-0a14-48af-8cd6-ad058d2ed0d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.267572 Sep 01 09:11:15.599565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 90/178] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:15 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:15.618028 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:15.619190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:15.627929 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:15.628435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:15.628901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:15.629764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:15.630249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:15.630700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:15.828547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:15.836782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c417b543-995e-4fc7-b492-3eeed694d859 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.223557 Sep 01 09:11:15.837960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 91/179] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:15 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:15.913881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:15.914497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:15.922292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:15.922879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:15.923293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:15.927556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:15.927556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:15.927556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.065330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:16.074098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:16.075895 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:16.077094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ee010aa0-1ae8-4fb5-8c9c-c2ca40fd8105 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.167084 Sep 01 09:11:16.081481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 92/180] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:15 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:11:16.125084 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:16.125701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:16.131588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.132075 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.132514 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.133211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.133788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.134210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.224568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-24ff60f6-a4c8-4eed-b6cc-9f90cbc2b5c1 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "POST /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.886121 Sep 01 09:11:16.225538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 89/181] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:11:13 2022] POST /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be/os-volume_attachments => generated 194 bytes in 2888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:11:16.366553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-beafbd37-c719-428a-b8c8-cbaec5bae09c req-b656df43-7f45-40b6-b634-4ab1e41ce700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20653d8d-9ed3-47c2-baa8-63e3ba1725bf", "name": "network-vif-plugged", "status": "completed", "tag": "c121e215-1c32-40c0-8a1e-fd1bc8f17a7d"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:16.377347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-beafbd37-c719-428a-b8c8-cbaec5bae09c req-b656df43-7f45-40b6-b634-4ab1e41ce700 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.378069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-beafbd37-c719-428a-b8c8-cbaec5bae09c req-b656df43-7f45-40b6-b634-4ab1e41ce700 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.378512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-beafbd37-c719-428a-b8c8-cbaec5bae09c req-b656df43-7f45-40b6-b634-4ab1e41ce700 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.390559 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-beafbd37-c719-428a-b8c8-cbaec5bae09c req-b656df43-7f45-40b6-b634-4ab1e41ce700 service nova] Creating event network-vif-plugged:c121e215-1c32-40c0-8a1e-fd1bc8f17a7d for instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf on hv-cinder-82002 Sep 01 09:11:16.396375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-beafbd37-c719-428a-b8c8-cbaec5bae09c req-b656df43-7f45-40b6-b634-4ab1e41ce700 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034162 Sep 01 09:11:16.397169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 90/182] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:16.442973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:16.448391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dd2a2afa-0b90-4614-b2a7-0be0c70796c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1555 microversion: 2.1 time: 0.327259 Sep 01 09:11:16.449054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 93/183] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:16 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1555 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:16.472797 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:16.473406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:16.479542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.480029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.480513 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.481140 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.481600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.482050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.562453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7e996342-e1a3-4218-b2f0-bc36ccfd3d6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094578 Sep 01 09:11:16.563035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 91/184] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:11:16 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:16.625955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:16.626564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:16.632719 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.633447 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.634083 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.634856 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.635347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.635775 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.798353 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:16.806567 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e9359b8b-1947-4c27-92d2-75dc45fc0cb2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.184407 Sep 01 09:11:16.807679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 94/185] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:16 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:16.858923 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:16.860126 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:16.867280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.868152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.868585 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:16.869283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:16.869912 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:16.870340 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:17.101553 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:17.102156 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:17.109512 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:17.110261 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:17.111362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:17.112068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:17.112651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:17.112974 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:17.129890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:17.137980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-69933d81-9513-4bb3-835c-9c8ffa648b97 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.284106 Sep 01 09:11:17.138565 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 92/186] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:16 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:17.253686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:17.261962 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:17.263585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:17.264699 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-24e1c8f0-ec72-4ec0-b998-de0cd76271fe tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.167099 Sep 01 09:11:17.265436 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 95/187] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:17 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:17.830418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:17.831076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:17.837204 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:17.837683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:17.838189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:17.838869 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:17.839522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:17.840100 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:18.033496 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:18.041640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b2fd3727-bba9-441a-9ac1-c7943d9e9545 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.216968 Sep 01 09:11:18.042300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 93/188] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:17 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:18.160004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:18.160610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:18.181481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:18.182161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-2243fd5b-4c0d-4155-ab59-75a51c95af43 req-b07d6941-2b5d-4908-aa74-ca98e90a2e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af02f0cb-1acf-48dd-8868-42cd5ebfff97", "tag": "3e896214-f87a-4a12-8bad-a6d953a69c92"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:18.185698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:18.186493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:18.189996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:18.190624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:18.192109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:18.207179 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-2243fd5b-4c0d-4155-ab59-75a51c95af43 req-b07d6941-2b5d-4908-aa74-ca98e90a2e88 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:18.207773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-2243fd5b-4c0d-4155-ab59-75a51c95af43 req-b07d6941-2b5d-4908-aa74-ca98e90a2e88 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:18.208409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-2243fd5b-4c0d-4155-ab59-75a51c95af43 req-b07d6941-2b5d-4908-aa74-ca98e90a2e88 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:18.223028 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-2243fd5b-4c0d-4155-ab59-75a51c95af43 req-b07d6941-2b5d-4908-aa74-ca98e90a2e88 service nova] Creating event network-changed:3e896214-f87a-4a12-8bad-a6d953a69c92 for instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 on hv-cinder-82002 Sep 01 09:11:18.229416 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-2243fd5b-4c0d-4155-ab59-75a51c95af43 req-b07d6941-2b5d-4908-aa74-ca98e90a2e88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051343 Sep 01 09:11:18.230487 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 94/189] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:18.292032 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:18.292741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:18.304831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:18.305181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:18.305940 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:18.306938 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:18.307594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:18.308028 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:18.414477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:18.424858 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-550b0a87-bc84-49a2-8f70-2239695712d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.270927 Sep 01 09:11:18.429024 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 96/190] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:18 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:18.529316 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:18.538794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:18.541615 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:18.543233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-35e41430-00a9-4264-8ef7-2fe4c8f05ad2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.256130 Sep 01 09:11:18.543914 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 95/191] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:18 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:19.073316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:19.074264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:19.081961 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:19.082920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:19.083613 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:19.084880 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:19.085550 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:19.086171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:19.227819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:19.236285 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fcdd9d59-348f-4373-bbce-2751ee2d010c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.167374 Sep 01 09:11:19.236939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 97/192] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:19 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:19.450582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:19.451890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:19.458762 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:19.459394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:19.459981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:19.460747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:19.461375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:19.461847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:19.567596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:19.568724 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:19.577975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:19.578683 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:19.579889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:19.580692 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:19.581256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:19.581795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:19.681162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:19.689810 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4ffd07d4-7249-4ffa-ba92-c0be67889526 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1360 microversion: 2.1 time: 0.243769 Sep 01 09:11:19.703644 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 96/193] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:19 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1360 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:19.771178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:19.782116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:19.799170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:19.799170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-270d26bc-2eda-4a06-bad1-70050e730a5c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.221439 Sep 01 09:11:19.799170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 98/194] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:19 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:11:20.264269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:20.264971 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:20.272781 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.273271 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.273703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:20.274580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.275041 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.275497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:20.426625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:20.434256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8383480b-f423-4545-8260-84fcc4086377 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.173764 Sep 01 09:11:20.434822 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 97/195] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:20 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:20.709647 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:20.710254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:20.716373 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.716906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.717497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:20.718833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.719460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.720091 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:20.820168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:20.821372 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:20.829199 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.829866 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.830466 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:20.831428 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.832131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.836816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:20.890994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:20.901539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-96e63221-cdf5-4e13-b79f-1004d53e54fa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1546 microversion: 2.1 time: 0.195336 Sep 01 09:11:20.916135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 99/196] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:20 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1546 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:20.934671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:20.935861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:20.955313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.955865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.956316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:20.957044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:20.959047 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:20.959547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:21.049956 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:21.059432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:21.061777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:21.062999 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-30a6ef1a-4e57-4a51-8b98-93ccf74d82fc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.247082 Sep 01 09:11:21.079140 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 98/197] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:20 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:21.227338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9328f0ad-1f74-4b42-8256-bb4a4985f7ff tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.304238 Sep 01 09:11:21.228014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 100/198] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:11:20 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-interface => generated 285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:21.456257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:21.456801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:21.462702 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:21.463221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:21.463662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:21.464384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:21.464842 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:21.465266 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:22.004969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:22.029093 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fa99795c-73a7-4a0f-ab64-030b49e43738 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.577339 Sep 01 09:11:22.044362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 99/199] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:21 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:22.088986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:22.090688 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:22.101079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:22.101800 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:22.102398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:22.104028 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:22.105029 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:22.106143 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:22.309621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:22.318642 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:22.323547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:22.323547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e97c0b89-edb1-4055-b3de-87605ac5f262 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.238741 Sep 01 09:11:22.323547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 101/200] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:22 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:22.602417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-08711676-d85d-45c8-bca4-b70c36610eec req-08bcb29d-0850-417b-a44d-6c408d99e304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfa76cf-89f5-4112-a5ae-859e051bbe0d", "name": "network-vif-plugged", "status": "completed", "tag": "8bfe0a67-ded1-411e-bbbd-beb319ed33d0"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:22.615716 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-08711676-d85d-45c8-bca4-b70c36610eec req-08bcb29d-0850-417b-a44d-6c408d99e304 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:22.616196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-08711676-d85d-45c8-bca4-b70c36610eec req-08bcb29d-0850-417b-a44d-6c408d99e304 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:22.616629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-08711676-d85d-45c8-bca4-b70c36610eec req-08bcb29d-0850-417b-a44d-6c408d99e304 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:22.628599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-08711676-d85d-45c8-bca4-b70c36610eec req-08bcb29d-0850-417b-a44d-6c408d99e304 service nova] Creating event network-vif-plugged:8bfe0a67-ded1-411e-bbbd-beb319ed33d0 for instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d on hv-cinder-82002 Sep 01 09:11:22.633653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-08711676-d85d-45c8-bca4-b70c36610eec req-08bcb29d-0850-417b-a44d-6c408d99e304 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039871 Sep 01 09:11:22.634252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 100/201] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:11:22.779426 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-3ccf3d86-fbab-4750-9e5a-066326dd6441 req-6f4280a1-84a9-4244-831a-9c596d9f20d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be4ee16-c20b-4744-9bb7-94a9afbb5415", "tag": "acaff261-2863-4f8a-85c5-32280f295ab4"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:22.790864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3ccf3d86-fbab-4750-9e5a-066326dd6441 req-6f4280a1-84a9-4244-831a-9c596d9f20d8 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:22.791557 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3ccf3d86-fbab-4750-9e5a-066326dd6441 req-6f4280a1-84a9-4244-831a-9c596d9f20d8 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:22.792049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3ccf3d86-fbab-4750-9e5a-066326dd6441 req-6f4280a1-84a9-4244-831a-9c596d9f20d8 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:22.804169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-3ccf3d86-fbab-4750-9e5a-066326dd6441 req-6f4280a1-84a9-4244-831a-9c596d9f20d8 service nova] Creating event network-changed:acaff261-2863-4f8a-85c5-32280f295ab4 for instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 on hv-cinder-82002 Sep 01 09:11:22.809580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-3ccf3d86-fbab-4750-9e5a-066326dd6441 req-6f4280a1-84a9-4244-831a-9c596d9f20d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033868 Sep 01 09:11:22.810462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 102/202] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:11:23.055556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:23.057726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:23.065873 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:23.066747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:23.067715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:23.068610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:23.069522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:23.070106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:23.318977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:23.330120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d1eb6f41-9570-45af-b08d-d4916192f22c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1320 microversion: 2.1 time: 0.281793 Sep 01 09:11:23.330749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 101/203] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:23 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:23.347427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:23.348853 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:23.356692 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:23.357308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:23.357844 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:23.358651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:23.359790 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:23.360450 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:23.686593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:23.690883 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:23.692370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:23.693803 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-61b0398d-7431-41ef-82bf-2bd070398401 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.352075 Sep 01 09:11:23.694410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 103/204] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:23 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:24.355376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:24.355376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:24.359955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.360437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.361121 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:24.361813 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.362451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.362866 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:24.496475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:24.504670 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b557cbf4-f5fa-412a-aebb-f0bd7cf861f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1513 microversion: 2.1 time: 0.157552 Sep 01 09:11:24.505244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 102/205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:24 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:24.526149 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:24.528342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:24.534267 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.534953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.535414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:24.536150 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.536591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.537007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:24.559624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:24.569972 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lazy-loading 'flavor' on Instance uuid 20653d8d-9ed3-47c2-baa8-63e3ba1725bf {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:11:24.727580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:24.728186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:24.734536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.735249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.735703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:24.736674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.737294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.737724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:24.872062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:24.881346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:24.882980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:24.884218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8c614206-72f1-4d57-9168-367ffcea98a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.160708 Sep 01 09:11:24.884923 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 103/206] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:24 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:11:24.897432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-27767cff-b657-4a49-a96e-127f5f2087c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf/action" status: 200 len: 32 microversion: 2.1 time: 0.375150 Sep 01 09:11:24.897991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 104/207] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:11:24 2022] POST /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:11:24.908427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:24.909036 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:24.915776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.916398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.916836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:24.917527 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:24.917969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:24.918391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:25.049653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:25.051332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:25.055983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fd585414-6df1-42db-9535-563dc6cc8028 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.152574 Sep 01 09:11:25.056602 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 104/208] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:24 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:25.909341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:25.910028 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:25.916648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:25.917183 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:25.917616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:25.918299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:25.918755 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:25.919205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:26.058443 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:26.077753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:26.081707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:26.081707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:26.082303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:26.082303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d513bd61-02f2-47e4-a76a-a0442b663000 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1407 microversion: 2.20 time: 0.176839 Sep 01 09:11:26.082303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 105/209] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:25 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:11:26.091554 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:26.092244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:26.092879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:26.094116 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:26.094747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:26.095212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:26.233424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:26.241826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4f1bbcab-c402-4733-8382-457d9e4bec21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.168115 Sep 01 09:11:26.242446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 105/210] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:26 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:27.103570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:27.104210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:27.110220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:27.110704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:27.111319 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:27.115493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:27.115493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:27.115493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:27.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:27.248189 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:27.249615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:27.251601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fbe26829-64ad-4e90-8dae-59b69dc1f569 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1598 microversion: 2.20 time: 0.151955 Sep 01 09:11:27.252168 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 106/211] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:11:27 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:11:27.263474 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:27.264083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:27.271943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:27.272427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:27.272860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:27.273545 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:27.274028 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:27.274453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:27.276631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:27.277313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:27.283422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:27.283868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:27.284308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:27.285004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:27.285484 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:27.285908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:27.362460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-70faa399-252e-4e30-bc5a-9d080d18edbb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089708 Sep 01 09:11:27.363066 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 107/212] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Sep 1 09:11:27 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 09:11:27.406208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:27.420920 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-169b96bf-3fe3-411f-b8dd-4025987d7f17 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.161095 Sep 01 09:11:27.421499 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 106/213] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:27 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:28.449812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:28.450879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:28.457079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:28.457669 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:28.458301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:28.459005 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:28.459495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:28.459926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:28.694321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:28.697799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-714a11f7-497b-4bed-8d84-71a84f5b2b91 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.251833 Sep 01 09:11:28.698418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 108/214] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:28 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:28.883092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-2aa068a1-f634-44de-a3d0-6f42821d9aa7 req-9eef962a-f411-4ca4-adbd-ffd477d2bfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfa76cf-89f5-4112-a5ae-859e051bbe0d", "tag": "8bfe0a67-ded1-411e-bbbd-beb319ed33d0"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:28.895542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-2aa068a1-f634-44de-a3d0-6f42821d9aa7 req-9eef962a-f411-4ca4-adbd-ffd477d2bfe3 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:28.896219 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-2aa068a1-f634-44de-a3d0-6f42821d9aa7 req-9eef962a-f411-4ca4-adbd-ffd477d2bfe3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:28.896815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-2aa068a1-f634-44de-a3d0-6f42821d9aa7 req-9eef962a-f411-4ca4-adbd-ffd477d2bfe3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:28.908784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-2aa068a1-f634-44de-a3d0-6f42821d9aa7 req-9eef962a-f411-4ca4-adbd-ffd477d2bfe3 service nova] Creating event network-changed:8bfe0a67-ded1-411e-bbbd-beb319ed33d0 for instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d on hv-cinder-82002 Sep 01 09:11:28.914631 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-2aa068a1-f634-44de-a3d0-6f42821d9aa7 req-9eef962a-f411-4ca4-adbd-ffd477d2bfe3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034659 Sep 01 09:11:28.916001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 107/215] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:29.726794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:29.739564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:29.746355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:29.746760 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:29.752950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:29.753783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:29.754445 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:29.755036 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:29.997901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:30.006703 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-184e15da-3431-4df7-b171-422760f2d9ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.290525 Sep 01 09:11:30.021208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 109/216] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:29 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:31.029937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:31.031505 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:31.037354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:31.037919 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:31.038660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:31.040154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:31.040937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:31.041569 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:31.221494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:31.232023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d45f6296-6fd7-4638-aef0-c48ea4c67da7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.207152 Sep 01 09:11:31.234263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 108/217] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:31 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:31.982425 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:31.987789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:31.988869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:31.989345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:31.989803 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:31.990479 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:31.990925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:31.991367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:32.019516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:11:32.255844 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:32.262097 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:32.265023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:32.265540 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:32.266033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:32.267208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:32.267684 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:32.268130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:32.425276 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:32.433799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f4eb3b57-593e-4c17-8b7d-8b051147d3fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.181167 Sep 01 09:11:32.436314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 109/218] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:32 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:32.437098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-95cddd73-41e9-45cf-8273-8d2c4d6e0dee tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "DELETE /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 204 len: 0 microversion: 2.1 time: 0.458111 Sep 01 09:11:32.438329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 110/219] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:11:31 2022] DELETE /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 09:11:32.452163 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:32.452766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:32.461109 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:32.461630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:32.462251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:32.462943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:32.463418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:32.463838 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:32.597304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:32.605878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0bd3fee3-272c-4320-9f7c-7814ca76e9a8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1553 microversion: 2.1 time: 0.158691 Sep 01 09:11:32.606681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 110/220] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:32 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:33.462229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:33.462229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:33.466300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:33.466784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:33.467251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:33.468068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:33.468392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:33.468814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:33.603654 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:33.611547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0e9315e0-54bc-47b4-bd81-4c6dfb53cf33 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.157681 Sep 01 09:11:33.613570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 111/221] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:33 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:33.628109 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:33.628846 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:33.635499 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:33.638528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:33.638528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:33.638528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:33.638528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:33.638907 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:33.772763 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:33.787957 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8d2f9b4d-56e5-42c8-8143-a41933574d31 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1553 microversion: 2.1 time: 0.161932 Sep 01 09:11:33.787957 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 111/222] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:33 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:34.633794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:34.634430 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:34.640308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:34.640856 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:34.641284 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:34.641973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:34.642422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:34.642854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:34.782442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:34.791576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5165e0e3-f51f-4188-853f-02ee793069a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.162250 Sep 01 09:11:34.804368 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 112/223] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:34 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:34.806437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:34.806984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:34.814033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:34.814680 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:34.815047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:34.815783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:34.816366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:34.816789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:34.955567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:34.964008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-19ee5818-80d2-4928-8457-7f7a210b75c4 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1553 microversion: 2.1 time: 0.161570 Sep 01 09:11:34.964596 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 112/224] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:34 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:35.814645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:35.814645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:35.820415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:35.820900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:35.821334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:35.822021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:35.822473 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:35.822894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:35.985677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:35.986586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:35.990504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=92 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:35.994552 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:35.995276 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:35.995760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:35.996513 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:35.996969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:35.997389 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:36.073731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:36.085774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-db8135e6-e5e3-43ce-bad8-50a91da270d8 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1511 microversion: 2.1 time: 0.103810 Sep 01 09:11:36.086734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 113/225] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:35 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1511 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:36.270501 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-18bf98ea-4c6a-459c-b4be-63dfddf691f3 req-75c4f8c0-d775-450d-a9ce-e4318f4083fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64746b2e-3205-48c6-83d4-77230c7226be", "name": "network-vif-deleted", "tag": "3d27e768-35dd-45bf-b9b7-c2e5c51c8430"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:11:36.283771 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:36.290931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-18bf98ea-4c6a-459c-b4be-63dfddf691f3 req-75c4f8c0-d775-450d-a9ce-e4318f4083fe service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:36.291449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-18bf98ea-4c6a-459c-b4be-63dfddf691f3 req-75c4f8c0-d775-450d-a9ce-e4318f4083fe service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:36.292376 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7181ee28-bdee-4363-944b-6fccf8b000e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.482197 Sep 01 09:11:36.292965 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 113/226] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:35 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:36.293105 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-18bf98ea-4c6a-459c-b4be-63dfddf691f3 req-75c4f8c0-d775-450d-a9ce-e4318f4083fe service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:36.317995 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-18bf98ea-4c6a-459c-b4be-63dfddf691f3 req-75c4f8c0-d775-450d-a9ce-e4318f4083fe service nova] Creating event network-vif-deleted:3d27e768-35dd-45bf-b9b7-c2e5c51c8430 for instance 64746b2e-3205-48c6-83d4-77230c7226be on hv-cinder-82002 Sep 01 09:11:36.327429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-18bf98ea-4c6a-459c-b4be-63dfddf691f3 req-75c4f8c0-d775-450d-a9ce-e4318f4083fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070109 Sep 01 09:11:36.333835 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 114/227] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:11:37.108525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:37.109142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:37.117932 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:37.118394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:37.118872 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:37.119753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:37.120677 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:37.121111 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:37.185898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:37.194637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-17b6a8b2-d967-4736-8c54-f40f5b339ae7 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1345 microversion: 2.1 time: 0.090758 Sep 01 09:11:37.195233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 114/228] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:37 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:37.315930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:37.316636 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:37.324075 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:37.324740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:37.325444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:37.326388 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:37.327047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:37.327647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:37.503861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:37.514154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f8c4ef6a-5b2f-4ae5-9085-3e02f0d135ec tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.203826 Sep 01 09:11:37.514913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 115/229] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:37 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:38.215746 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:38.217158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:38.224576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:38.225300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:38.225911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:38.226785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:38.228023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:38.228671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:38.268304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:38.269017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:38.269608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:38.270206 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lazy-loading 'fault' on Instance uuid 64746b2e-3205-48c6-83d4-77230c7226be {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:11:38.316203 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d6f82f9aa6447591cdd55d2a040ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27cafb5f07e449295c45c033ee62256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:38.325725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ec3baca7-eb2f-4fa2-8e1c-fb3f2ce65028 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 200 len: 1350 microversion: 2.1 time: 0.113895 Sep 01 09:11:38.326344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 115/230] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:38 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:38.536468 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:38.537670 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:38.544890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:38.545370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:38.545799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:38.546521 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:38.546998 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:38.548053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:38.694244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:38.703024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-47c3a31d-6280-43d1-8658-ef38613386bf tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.170524 Sep 01 09:11:38.704739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 116/231] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:38 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:39.347004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:39.347651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:39.353593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:39.354078 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:39.354519 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:39.355234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:39.355693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:39.356124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:39.371295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] HTTP exception thrown: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Request method failure captured: Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be HTTP/1.1 Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb9IpHdfDntlGZyZZ_F8Rp_KnxoAYdcmTL4rMKvJjkp9rNGZr5FI83_QgR5LuSdbmA3YgKEH5_1QeGK34pfEiEVaQY4uMBkI1sUBGL6FagtyRdPWH6srcOElKOtXqimbMQBPTD6pwyt4ekBfJesmIj7R2Qty0-eo7fRUOXW2BSggqM Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:11:39.382278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27cafb5f07e449295c45c033ee62256", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27cafb5f07e449295c45c033ee62256"}]}] Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: f6d6f82f9aa6447591cdd55d2a040ea4 Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.387900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '64746b2e-3205-48c6-83d4-77230c7226be'} Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:11:39.388823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.390185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.393667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Returning 404 to user: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:11:39.393667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bfd2d1e3-a018-4d0d-a318-3ba9cd3d84cb tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 404 len: 111 microversion: 2.1 time: 0.041039 Sep 01 09:11:39.393667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 116/232] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:39 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:11:39.503569 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:39.504055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:39.510032 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:39.510510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:39.510939 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:39.511649 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:39.512096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:39.512516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:39.526495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] HTTP exception thrown: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Request method failure captured: Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be/os-volume_attachments HTTP/1.1 Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb9IpHdfDntlGZyZZ_F8Rp_KnxoAYdcmTL4rMKvJjkp9rNGZr5FI83_QgR5LuSdbmA3YgKEH5_1QeGK34pfEiEVaQY4uMBkI1sUBGL6FagtyRdPWH6srcOElKOtXqimbMQBPTD6pwyt4ekBfJesmIj7R2Qty0-eo7fRUOXW2BSggqM Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:11:39.537076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27cafb5f07e449295c45c033ee62256", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27cafb5f07e449295c45c033ee62256"}]}] Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: f6d6f82f9aa6447591cdd55d2a040ea4 Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.538717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'server_id': '64746b2e-3205-48c6-83d4-77230c7226be'} Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:11:39.539432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:39.540500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:11:39.541977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Returning 404 to user: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:11:39.541977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cab22e98-dc91-4f91-a344-ab9fab49fa37 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040931 Sep 01 09:11:39.541977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 117/233] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:11:39 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 09:11:39.733894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:39.734672 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:39.746947 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:39.747471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:39.747900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:39.748764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:39.749378 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:39.749804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:39.899600 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:39.910708 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3309262d-ba4e-4850-82c5-2610cbfe14d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.189681 Sep 01 09:11:39.911316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 117/234] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:39 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:40.936676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:40.938181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:40.946606 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:40.947479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:40.947918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:40.948631 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:40.949037 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:40.949796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:40.970097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:40.971186 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:40.977733 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:40.978974 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:40.978974 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:40.979453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:40.979902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:40.980318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:40.999012 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:41.001294 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] HTTP exception thrown: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Request method failure captured: Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: DELETE /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be HTTP/1.1 Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb9IpHdfDntlGZyZZ_F8Rp_KnxoAYdcmTL4rMKvJjkp9rNGZr5FI83_QgR5LuSdbmA3YgKEH5_1QeGK34pfEiEVaQY4uMBkI1sUBGL6FagtyRdPWH6srcOElKOtXqimbMQBPTD6pwyt4ekBfJesmIj7R2Qty0-eo7fRUOXW2BSggqM Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:11:41.003068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27cafb5f07e449295c45c033ee62256", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27cafb5f07e449295c45c033ee62256"}]}] Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: f6d6f82f9aa6447591cdd55d2a040ea4 Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.004395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '64746b2e-3205-48c6-83d4-77230c7226be'} Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:11:41.008092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.009572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.010886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Returning 404 to user: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:11:41.010886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-28b5cf0b-c1ff-4225-b072-203a15205b59 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "DELETE /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 404 len: 111 microversion: 2.1 time: 0.040577 Sep 01 09:11:41.010886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 118/235] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:11:40 2022] DELETE /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:11:41.015486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:41.017135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] [instance: 64746b2e-3205-48c6-83d4-77230c7226be] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:41.024303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:41.025069 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:41.025671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:41.026503 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:41.027237 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:41.027842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:41.043516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] HTTP exception thrown: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Request method failure captured: Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be HTTP/1.1 Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb9IpHdfDntlGZyZZ_F8Rp_KnxoAYdcmTL4rMKvJjkp9rNGZr5FI83_QgR5LuSdbmA3YgKEH5_1QeGK34pfEiEVaQY4uMBkI1sUBGL6FagtyRdPWH6srcOElKOtXqimbMQBPTD6pwyt4ekBfJesmIj7R2Qty0-eo7fRUOXW2BSggqM Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:11:41.045038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27cafb5f07e449295c45c033ee62256", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27cafb5f07e449295c45c033ee62256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27cafb5f07e449295c45c033ee62256"}]}] Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: e27cafb5f07e449295c45c033ee62256 Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-DeleteServersTestJSON-1790092035 Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: f6d6f82f9aa6447591cdd55d2a040ea4 Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-DeleteServersTestJSON-1790092035-project Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.046349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '64746b2e-3205-48c6-83d4-77230c7226be'} Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:11:41.047018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. Sep 01 09:11:41.048812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:11:41.049788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] Returning 404 to user: Instance 64746b2e-3205-48c6-83d4-77230c7226be could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:11:41.049788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-35ef91e3-bce4-4b21-8ec4-80183751d777 tempest-DeleteServersTestJSON-1790092035 tempest-DeleteServersTestJSON-1790092035-project] 10.222.0.46 "GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be" status: 404 len: 111 microversion: 2.1 time: 0.036018 Sep 01 09:11:41.049788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 119/236] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:41 2022] GET /compute/v2.1/servers/64746b2e-3205-48c6-83d4-77230c7226be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:11:41.107756 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:41.116362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-04e72e0a-ae50-481a-baa4-545e60fff46b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.184068 Sep 01 09:11:41.130937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 118/237] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:40 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:42.137801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:42.140029 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:42.145822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:42.146296 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:42.146774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:42.147546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:42.147942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:42.148360 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:42.401291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:42.410287 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c38eb507-570a-4bca-9e0c-105ba2e5ad7b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.276167 Sep 01 09:11:42.424394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 120/238] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:42 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:43.436469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:43.439261 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:43.455548 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:43.456021 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:43.456502 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:43.459631 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:43.460395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:43.461332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:43.606867 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:43.619354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5f6183f3-29b2-4e79-8038-ed5fa433f971 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.190149 Sep 01 09:11:43.620300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 119/239] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:43 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:44.642369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:44.643731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:44.650912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:44.652540 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:44.654571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:44.654571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:44.654571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:44.655337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:44.656195 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:44.817303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:44.824923 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5b824f28-6643-4740-aa76-597dd073a817 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.187258 Sep 01 09:11:44.827409 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 121/240] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:44 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:45.846354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:45.847074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:45.853546 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:45.854035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:45.854469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:45.855189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:45.855646 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:45.856069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:46.043156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:46.051079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1c24bee7-5b65-42ab-8ed9-02bb9e1bbd3a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.209126 Sep 01 09:11:46.051843 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 120/241] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:45 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:47.071800 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:47.072406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:47.078434 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:47.078956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:47.079767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:47.080256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:47.080706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:47.081231 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:47.245183 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:47.253118 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c39d229c-4891-45dd-897e-30bcba38200a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.185019 Sep 01 09:11:47.253695 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 122/242] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:47 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:48.276336 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:48.276954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:48.283890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:48.284416 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:48.284878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:48.285588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:48.286066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:48.286520 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:48.427833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:48.436285 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e91fcf92-5cd5-48a7-8391-cc0e540096ea tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.165919 Sep 01 09:11:48.439796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 121/243] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:48 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:49.458255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:49.458864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:49.465078 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:49.465564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:49.465992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:49.466675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:49.467147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:49.467566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:49.594935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:49.602561 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ada0a675-0d7a-4ddd-8bb7-3eddcec00553 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.148818 Sep 01 09:11:49.603147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 123/244] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:49 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:11:50.623292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:50.623910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:50.630490 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:50.630979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:50.631464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:50.632159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:50.632617 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:50.633044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:50.761846 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:50.770640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-516fdfc4-6717-41bd-9461-c0bd62659fef tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.151376 Sep 01 09:11:50.771289 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 122/245] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:50 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:51.792290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:51.792904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:51.798792 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:51.799975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:51.800435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:51.801120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:51.801571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:51.801992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:51.929730 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:51.937330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8e21c3fc-b61f-4b80-aa2d-9060d711444e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.149097 Sep 01 09:11:51.937906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 124/246] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:51 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:52.957990 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:52.958588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:52.964937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:52.965455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:52.965904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:52.966613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:52.967061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:52.967502 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:52.985378 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:11:53.095662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:53.103945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-645dca12-3516-4a71-9b09-c8c882e33ed3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.150036 Sep 01 09:11:53.104521 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 123/247] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:52 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:54.125552 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:54.126156 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:54.132675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:54.133153 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:54.133586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:54.134263 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:54.134712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:54.135273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:54.261707 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:54.269460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-be7ff48c-58f2-4504-80fc-83d6b0bc70d8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.147723 Sep 01 09:11:54.270034 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 125/248] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:54 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:55.290251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:55.290860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:55.297652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:55.298132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:55.298565 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:55.299285 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:55.300235 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:55.300666 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:55.428129 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:55.435866 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6315e703-5d82-4be4-9d90-58d61b6308a3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.149428 Sep 01 09:11:55.436446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 124/249] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:55 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:56.458003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:56.458612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:56.464686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:56.465175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:56.465612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:56.466299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:56.466760 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:56.467246 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:56.597361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:56.605009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-de7343f5-ff69-464b-9522-d2a826cf6717 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.151080 Sep 01 09:11:56.605578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 126/250] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:56 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:57.625608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:57.626211 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:57.633230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:57.633738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:57.634164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:57.634842 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:57.635332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:57.635754 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:57.761803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:57.769995 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-01a0f403-90a6-4ebd-869b-3561b47e80f5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.148207 Sep 01 09:11:57.770553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 125/251] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:57 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:58.790509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:58.791132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:58.797426 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:58.797914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:58.798352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:58.799038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:58.800123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:58.800592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:58.926661 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:11:58.934169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-87da2f56-1957-459d-9bb6-ea49fc5d7311 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.147552 Sep 01 09:11:58.934729 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 127/252] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:58 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:11:59.955024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:11:59.956276 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:11:59.962694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:59.963212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:59.963644 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:11:59.964321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:11:59.964770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:11:59.965188 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:00.103415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:00.112017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3f332ede-9c36-4f11-9b3d-cf00bcf43190 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.160722 Sep 01 09:12:00.112604 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 126/253] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:11:59 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:01.134424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:01.135038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:01.141129 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:01.141617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:01.142054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:01.142742 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:01.143282 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:01.143837 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:01.276424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:01.284155 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-038b4f87-05bc-4736-92a9-8ab0449f3eb5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.153645 Sep 01 09:12:01.284853 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 128/254] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:01 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:02.305713 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:02.306350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:02.312508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:02.312983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:02.313413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:02.314132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:02.314578 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:02.315549 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:02.636293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:02.644016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cd1b4b3b-3890-4d24-bc57-8809bc1a49a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.342100 Sep 01 09:12:02.644718 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 127/255] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:02 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:03.665230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:03.665841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:03.672568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:03.673050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:03.673488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:03.674167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:03.674698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:03.675244 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:03.801546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:03.811694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e5fbf374-6a5a-4d5e-80e2-ae3bd76eb69a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.147930 Sep 01 09:12:03.811694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 129/256] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:03 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:04.831839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:04.832734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:04.839556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:04.840324 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:04.840812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:04.841508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:04.841991 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:04.842413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:04.976835 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:04.984603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b10c9730-0b52-4cca-9d05-ecfe51d7f79e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.157828 Sep 01 09:12:04.985212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 128/257] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:04 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:06.006751 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:06.007327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:06.013214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:06.013692 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:06.014120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:06.014806 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:06.015296 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:06.015722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:06.143297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:06.151701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9523d6da-d25d-4500-a9d8-94c50c807a7a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1519 microversion: 2.1 time: 0.149464 Sep 01 09:12:06.152291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 130/258] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:06 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:07.174854 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:07.174854 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:07.176987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=32 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:07.181679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:07.182161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:07.182592 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:07.183315 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:07.183765 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:07.184188 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:07.330311 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:07.338698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d2b85506-0b39-4380-b62d-e5ace1f74a54 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1499 microversion: 2.1 time: 0.169066 Sep 01 09:12:07.339321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 129/259] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:07 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:07.359823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:07.361157 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:07.367596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:07.368073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:07.368505 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:07.369216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:07.369665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:07.370082 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:07.504581 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:07.513135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0c8a38a4-0106-4ac9-8410-28af50e2fbbd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1515 microversion: 2.1 time: 0.156926 Sep 01 09:12:07.513730 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 131/260] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:07 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:16.670756 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:12:16.673211 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:16.680792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:16.681290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:16.681722 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:16.682416 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:16.682865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:16.683314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:16.707946 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lazy-loading 'flavor' on Instance uuid 85c3385c-4154-40a0-bebe-a0f7be2dcc9b {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:12:17.276919 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-00e9e6e9-4998-4f94-b67f-e635d1fe61fb tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b/action" status: 200 len: 32 microversion: 2.1 time: 0.613875 Sep 01 09:12:17.277905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 130/261] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:12:16 2022] POST /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b/action => generated 32 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:12:17.288237 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:17.289404 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:17.294204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=22 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:17.297995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:17.298486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:17.298920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:17.299708 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:17.300179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:17.300602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:17.304752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=75 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:17.445591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:17.455381 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9476ca63-e427-4e3a-99ef-119f543e85f9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.171993 Sep 01 09:12:17.457006 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 132/262] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:17 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:18.479972 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:18.480717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:18.488380 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:18.488884 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:18.489323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:18.490025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:18.490492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:18.490951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:18.649247 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:18.652738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d36f0809-dac4-4e0c-b05c-6e46834fcd2c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.176973 Sep 01 09:12:18.654009 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 131/263] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:18 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:19.674608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:19.675243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:19.682030 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:19.682521 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:19.682959 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:19.683685 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:19.684142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:19.684574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:19.820594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:19.828267 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6ea79b8f-c0bc-4e40-81f2-5ff353af58a2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.158168 Sep 01 09:12:19.828841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 133/264] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:19 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:20.850259 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:20.851766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:20.858655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:20.859233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:20.859614 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:20.860313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:20.860769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:20.861196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:21.025881 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:21.033478 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2c96d289-6f96-470c-96fd-61186516817f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.187456 Sep 01 09:12:21.034069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 132/265] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:20 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:22.057094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:22.058451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:22.064596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:22.065152 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:22.066116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:22.067124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:22.067791 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:22.072327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:22.201948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:22.211526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2b17d8cd-96b9-46ce-b9c4-389e4dce3231 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.158535 Sep 01 09:12:22.212190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 134/266] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:22 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:23.236227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:23.236227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:23.242160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:23.242714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:23.243911 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:23.244750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:23.251526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:23.251526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:23.251526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:23.380825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:23.389356 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4159a12d-cc92-4d92-bf0c-4539bb57da8a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.158031 Sep 01 09:12:23.389989 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 133/267] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:23 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:24.411281 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:24.411893 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:24.418354 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:24.418837 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:24.423264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:24.423264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:24.423264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:24.423264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:24.557174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:24.573057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f9637fc9-c255-4f2c-9078-631806976e8d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.165609 Sep 01 09:12:24.579811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 135/268] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:24 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:25.593519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:25.594165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:25.600495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:25.600981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:25.601418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:25.602201 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:25.602796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:25.603263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:25.735277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:25.743456 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-521f4a8c-11eb-45de-92ed-fe3dc4df2e13 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.153305 Sep 01 09:12:25.744031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 134/269] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:25 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:26.764854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:26.765486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:26.771352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:26.771831 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:26.772262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:26.772982 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:26.773436 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:26.773853 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:26.902609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:26.910251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bf89183a-0dfa-4637-ad8a-0dd97d827415 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.149243 Sep 01 09:12:26.911119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 136/270] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:26 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:27.931702 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:27.932244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:27.939070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:27.939576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:27.940008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:27.940694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:27.941143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:27.941565 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:28.069897 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:28.077529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-16a01edd-261e-437e-9d3e-6353a9e9b715 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.149801 Sep 01 09:12:28.078094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 135/271] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:27 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:29.105771 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:29.106477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:29.112537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:29.113001 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:29.113436 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:29.114124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:29.114579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:29.115002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:29.243369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:29.254809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-becd3bfa-cf11-422b-a4e6-f93211504388 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.149530 Sep 01 09:12:29.254809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 137/272] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:29 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:30.272426 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:30.273081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:30.280010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:30.280495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:30.280943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:30.281638 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:30.282096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:30.282529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:30.410148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:30.418729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-24ef2b5c-273b-4264-9e27-82f97330030d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.150179 Sep 01 09:12:30.419320 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 136/273] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:30 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:31.440072 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:31.440689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:31.446647 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:31.447174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:31.447615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:31.448302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:31.448759 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:31.449187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:31.578781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:31.586499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ba6b02da-8d70-4f41-9f62-3200bb2118e5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.150295 Sep 01 09:12:31.587083 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 138/274] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:31 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:32.608079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:32.608757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:32.615142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:32.615634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:32.616077 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:32.616767 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:32.617226 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:32.617654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:32.749125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:32.756750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7e185824-c239-4339-976e-33a3a8171452 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.152516 Sep 01 09:12:32.765344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 137/275] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:32 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:33.784397 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:33.784994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:33.791576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:33.791818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:33.792249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:33.792927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:33.793626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:33.794044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:33.921444 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:33.929181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-73a4896b-a219-4277-9c8a-e098e4c5e0df tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.148644 Sep 01 09:12:33.929739 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 139/276] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:33 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:34.951090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:34.951738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:34.958459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:34.958953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:34.959460 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:34.960189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:34.960670 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:34.961100 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:35.093572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:35.101399 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-81e56cb1-8eb2-4ad5-a94b-13afed8dd45a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.154755 Sep 01 09:12:35.101969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 138/277] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:34 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:36.122640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:36.123322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:36.129240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:36.129720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:36.130149 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:36.130830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:36.131315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:36.131732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:36.261582 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:36.269134 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-aab9bb5e-bc69-4bac-9380-bbfa1a8411c5 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.150378 Sep 01 09:12:36.269694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 140/278] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:36 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:37.290501 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:37.291638 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:37.297468 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=20 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:37.299252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:37.299790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:37.300165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:37.300864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:37.301323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:37.301750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:37.428660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:37.437240 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-82e79486-3712-4229-a01e-9cd5aed07165 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.150441 Sep 01 09:12:37.437826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 139/279] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:37 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:38.458329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:38.458935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:38.465439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:38.465897 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:38.466344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:38.467011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:38.467492 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:38.467913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:38.593040 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:38.600898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-be589c81-56ad-49ec-aae5-d202d271cf75 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.146346 Sep 01 09:12:38.601473 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 141/280] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:38 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:12:39.623089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:39.623657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:39.630111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:39.630598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:39.631037 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:39.631753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:39.632213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:39.632642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:39.763231 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:39.772834 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-95c7456f-2d9e-49ec-8d03-863ef83cecaa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.154670 Sep 01 09:12:39.773407 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 140/281] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:39 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:40.797493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:40.798385 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:40.804978 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:40.805501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:40.805968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:40.806721 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:40.807208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:40.807663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:40.938302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:40.946024 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5094a11e-7f56-408e-a1e9-f7f989b26da9 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.154259 Sep 01 09:12:40.946590 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 142/282] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:40 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:41.967859 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:41.968421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:41.974721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:41.975244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:41.975685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:41.976370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:41.976825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:41.977252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:42.105218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:42.112876 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-542f7852-16d6-41bf-b32c-61f9c2e408b1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1501 microversion: 2.1 time: 0.150215 Sep 01 09:12:42.113454 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 141/283] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:41 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:42.133490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c09050c-07f9-4a1d-b6b0-7a12146c1aad"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:12:42.136003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:42.142658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:42.147542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:42.147542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:42.147542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:42.147542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:42.148097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:42.168339 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] HTTP exception thrown: Cannot 'attach_volume' instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b while it is in vm_state rescued Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Request method failure captured: Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: POST /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b/os-volume_attachments HTTP/1.1 Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 74 Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHcF-34v__ijpg5r_L6XoV5szpExUjxYjZ_MYqWfxdNN5WfuYpdM9xtKyFWCpNbusOHbnv5GIpJ2pdzjZmG1BIlWZNBy8R86JFAYOm2wKyA6h4EvpVWQeXCEmDCrJxStgbmuFK4ZabdMnDc5l96OSVESfAH7TbsvMmaFH160n4LRggM Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:12:42.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15f1ee0d68f646bcad60cbf31c3c684d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15f1ee0d68f646bcad60cbf31c3c684d"}]}] Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 81816508df7c431fa3b4b495d11ac101 Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {"volumeAttachment": {"volumeId": "7c09050c-07f9-4a1d-b6b0-7a12146c1aad"}} Sep 01 09:12:42.172545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Cannot 'attach_volume' instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b while it is in vm_state rescued Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'server_id': '85c3385c-4154-40a0-bebe-a0f7be2dcc9b', 'body': {'volumeAttachment': {'volumeId': '7c09050c-07f9-4a1d-b6b0-7a12146c1aad'}}} Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:12:42.173355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b while it is in vm_state rescued Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:12:42.174499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:12:42.175603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:12:42.175603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:12:42.175603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b while it is in vm_state rescued Sep 01 09:12:42.175603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:12:42.175603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Returning 409 to user: Cannot 'attach_volume' instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b while it is in vm_state rescued {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:12:42.175603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-75fe1b4b-4e80-4da8-b842-faa1cf173d86 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043032 Sep 01 09:12:42.175603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 143/284] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:12:42 2022] POST /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 09:12:42.181573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:12:42.182103 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:42.188506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:42.188978 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:42.189406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:42.190080 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:42.190524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:42.190986 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:42.419479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-27a1e507-2a6f-4eb8-9d29-842baf8bf852 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b/action" status: 202 len: 0 microversion: 2.1 time: 0.241220 Sep 01 09:12:42.420397 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 142/285] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:12:42 2022] POST /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 09:12:42.428477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:42.429090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:42.436210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:42.436692 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:42.437120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:42.437827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:42.438273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:42.438693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:42.569615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:42.578083 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-682c2955-14fe-453f-bc99-d16fc0aa6aa7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1509 microversion: 2.1 time: 0.153444 Sep 01 09:12:42.578695 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 144/286] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:42 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:12:43.601254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:43.602006 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:43.608766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:43.610689 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:43.610689 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:43.610689 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:43.610983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:43.611220 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:43.748016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:43.756025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7543d09f-f180-494a-8205-26642e2d5f8c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1509 microversion: 2.1 time: 0.159512 Sep 01 09:12:43.756588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 143/287] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:43 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:44.776888 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:44.777588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:44.783686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:44.784174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:44.784614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:44.785313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:44.785774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:44.786201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:44.921002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:44.936068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-647f94a8-9552-458e-b613-181eea00fd68 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1509 microversion: 2.1 time: 0.162889 Sep 01 09:12:44.936666 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 145/288] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:44 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:45.957749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:45.958947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:45.965448 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:45.965938 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:45.966392 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:45.967076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:45.967561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:45.967969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:46.100284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:46.108750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4984f0f5-236b-44a7-b1a3-4d4fd8e621b3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1509 microversion: 2.1 time: 0.154844 Sep 01 09:12:46.109504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 144/289] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:45 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:47.129948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:47.130466 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:47.136621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:47.137103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:47.137536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:47.138265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:47.138713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:47.142580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:47.264603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:47.272224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5e27df3a-faf9-4182-9fd3-c764868e134f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1515 microversion: 2.1 time: 0.146052 Sep 01 09:12:47.272732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 146/290] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:47 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:53.101110 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6bc93d17-9cf9-41d1-b909-fc205992501c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'create', calling method: .version_select at 0x7f7a655a98b0>, body: {"keypair": {"name": "tempest-keypair-605699803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK7P7kPtU6ECF5/ik9pXYABfmIj5Zx/5Y+mZMESrzH8yFtO5YiMjFKnrqpq/F9EgeeSOcve1uSTWG/ctZz7w6B9mRb9kQpZMizcHntaOcpPN01ms0/sm5+MI70Q3cesGg=="}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:12:53.117962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-6bc93d17-9cf9-41d1-b909-fc205992501c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:12:53.121909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-6bc93d17-9cf9-41d1-b909-fc205992501c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for user 81816508df7c431fa3b4b495d11ac101 and project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:12:53.218225 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6bc93d17-9cf9-41d1-b909-fc205992501c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121069 Sep 01 09:12:53.218842 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 145/291] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:12:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:12:55.597799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1822681357", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9bfe5de-813e-4a58-8ca9-0d815bfc6f58"}], "security_groups": [{"name": "tempest-securitygroup--360859169"}], "key_name": "tempest-keypair-605699803", "user_data": "}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:12:55.606337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=30 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:55.700019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] validate_networks() for [('c9bfe5de-813e-4a58-8ca9-0d815bfc6f58', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:12:56.308627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:12:56.309054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:12:56.309564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:12:56.309975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:12:56.310391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:12:56.319749 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:56.320243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:56.320681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:56.321405 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:56.321863 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:56.322292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:56.330452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=88 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:56.340951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:12:56.345092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Getting quotas for user 81816508df7c431fa3b4b495d11ac101 and project 15f1ee0d68f646bcad60cbf31c3c684d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:12:56.356259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:12:56.358516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:12:56.511774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bbe068ed-cd7f-4db7-bc82-efef358a43f0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.919204 Sep 01 09:12:56.512607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 147/292] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:12:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:12:56.521314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:12:56.532694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-67e3fa09-b3a2-487b-a5a0-e9105b82d172 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:56.533636 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-67e3fa09-b3a2-487b-a5a0-e9105b82d172 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:56.609267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-67e3fa09-b3a2-487b-a5a0-e9105b82d172 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:56.621014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-67e3fa09-b3a2-487b-a5a0-e9105b82d172 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1245 microversion: 2.1 time: 0.100957 Sep 01 09:12:56.622223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 146/293] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:56 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:57.642315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:57.642932 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:57.649106 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:57.649595 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:57.650253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:57.650721 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:57.651215 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:57.651645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:57.713069 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:57.720761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0d167f90-2e38-49de-b3c1-87be1899f275 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1249 microversion: 2.1 time: 0.082846 Sep 01 09:12:57.721327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 148/294] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:57 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:58.741939 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:58.742667 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:58.749753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:58.750245 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:58.750724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:58.751462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:58.751923 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:58.752377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:58.815147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:12:58.822568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-02b5c545-277b-4789-8f7d-d74e03a818bc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1297 microversion: 2.1 time: 0.084841 Sep 01 09:12:58.833722 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 147/295] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:58 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:12:59.844311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:12:59.845025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:12:59.855996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:59.856681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:59.858239 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:12:59.860375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:12:59.861232 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:12:59.862930 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:00.222701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:00.231662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fd12ebe5-ea80-4500-9cc5-690fa5efb76c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.392118 Sep 01 09:13:00.232503 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 149/296] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:12:59 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:00.612184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-da14f6fa-dc6a-4ddb-9c5a-49c7ff253bb4 req-c529f256-9121-4b25-8c64-5ed637cfc5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0760e1d-3d2e-4eae-b113-78ed44c4f6a4", "tag": "6fd3f0b1-2b81-45bc-8411-6aa0f55497df"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:00.622437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-da14f6fa-dc6a-4ddb-9c5a-49c7ff253bb4 req-c529f256-9121-4b25-8c64-5ed637cfc5bf service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:00.622996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-da14f6fa-dc6a-4ddb-9c5a-49c7ff253bb4 req-c529f256-9121-4b25-8c64-5ed637cfc5bf service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:00.623512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-da14f6fa-dc6a-4ddb-9c5a-49c7ff253bb4 req-c529f256-9121-4b25-8c64-5ed637cfc5bf service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:00.635038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-da14f6fa-dc6a-4ddb-9c5a-49c7ff253bb4 req-c529f256-9121-4b25-8c64-5ed637cfc5bf service nova] Creating event network-changed:6fd3f0b1-2b81-45bc-8411-6aa0f55497df for instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 on hv-cinder-82002 Sep 01 09:13:00.639887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-da14f6fa-dc6a-4ddb-9c5a-49c7ff253bb4 req-c529f256-9121-4b25-8c64-5ed637cfc5bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032291 Sep 01 09:13:00.640981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 148/297] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:01.253938 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:01.254553 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:01.260749 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:01.261253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:01.261686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:01.262366 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:01.262818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:01.263275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:01.400219 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:01.400701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9a3abaf7-7a34-4a49-8e58-c76391c32f43 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.150742 Sep 01 09:13:01.401264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 150/298] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:01 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:02.423654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:02.424348 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:02.430376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:02.430915 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:02.431399 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:02.432059 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:02.432509 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:02.432929 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:02.563043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:02.571277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cd567ba3-7ae7-44a2-b574-59a68f374f53 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.153131 Sep 01 09:13:02.579363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 149/299] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:02 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:03.592745 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:03.593359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:03.599320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:03.599817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:03.600257 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:03.600944 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:03.601400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:03.601830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:03.732103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:03.739856 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-be0e1c91-d1bd-4e91-ad20-7d8363bab7aa tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.150940 Sep 01 09:13:03.740449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 151/300] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:03 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:04.761531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:04.762284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:04.769529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:04.770012 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:04.770453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:04.771163 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:04.771622 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:04.772095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:04.901714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:04.909314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8775a261-2703-4fae-a3b1-7a44311056cc tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.151684 Sep 01 09:13:04.909882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 150/301] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:04 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:05.931008 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:05.931648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:05.937637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:05.938622 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:05.939062 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:05.939763 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:05.940215 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:05.940649 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:05.993111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-780834080", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "networks": [{"uuid": "5c7dd9f9-ad93-443c-b721-1a4810263c92"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:06.048943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] validate_networks() for [('5c7dd9f9-ad93-443c-b721-1a4810263c92', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:13:06.073214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:06.082096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c5434649-5b59-43e2-a3eb-f910a6f91931 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.154737 Sep 01 09:13:06.082936 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 152/302] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:05 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:06.417874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:13:06.422914 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:13:06.422914 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:13:06.422914 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:13:06.422914 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:13:06.429444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:06.429924 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:06.430365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:06.431125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:06.431606 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:06.432030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:06.449875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Getting quotas for project 79d23226b59c44f7bd30d9386494f4b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:13:06.454040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Getting quotas for user 602d298896d643a098bcbc1853dddbb7 and project 79d23226b59c44f7bd30d9386494f4b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:13:06.466473 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:13:06.468783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:13:06.556941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4f232a63-c335-4305-938b-4389fe7f9428 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567569 Sep 01 09:13:06.557809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 151/303] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 09:13:06.569423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-30a38acd-bdb2-4af4-ab4f-cf1d434017c1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:06.570031 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-30a38acd-bdb2-4af4-ab4f-cf1d434017c1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:06.571885 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:06.572537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:06.624387 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-30a38acd-bdb2-4af4-ab4f-cf1d434017c1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:06.631799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-30a38acd-bdb2-4af4-ab4f-cf1d434017c1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1213 microversion: 2.1 time: 0.066163 Sep 01 09:13:06.632548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 153/304] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:06 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:07.106898 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:07.107621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:07.114881 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:07.115496 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:07.115995 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:07.116875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:07.117496 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:07.117985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:07.245894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:07.253745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6f3fa172-1f19-4d9d-a2d6-5cba64595fc3 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.154319 Sep 01 09:13:07.257507 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 152/305] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:07 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:07.653319 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:07.653946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:07.660711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:07.661197 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:07.661638 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:07.662327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:07.662867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:07.663229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:07.727446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:07.735245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4d439bab-aebe-4573-8713-f5c408a43344 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1217 microversion: 2.1 time: 0.086146 Sep 01 09:13:07.735868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 154/306] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:07 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:08.276605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:08.277217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:08.279690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:08.284482 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:08.284966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:08.285403 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:08.286091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:08.286802 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:08.287264 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:08.425192 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:08.432924 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c916bb08-f686-448e-b192-041f06397467 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.160712 Sep 01 09:13:08.434316 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 153/307] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:08 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:08.756326 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:08.756934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:08.762800 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:08.763320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:08.763759 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:08.764448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:08.764900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:08.765324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:08.826374 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:08.834499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5ebb7bca-c13c-46fd-bd92-fba604b0b833 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1265 microversion: 2.1 time: 0.082025 Sep 01 09:13:08.835173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 155/308] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:08 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:09.455572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:09.456757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:09.463337 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:09.463819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:09.464248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:09.465086 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:09.465538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:09.465958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:09.607083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:09.616551 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-602a4284-5b31-4cee-b7dd-05d38b5fa11d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.164904 Sep 01 09:13:09.617377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 154/309] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:09 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:09.856196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:09.856816 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:09.863508 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:09.864403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:09.864854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:09.865629 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:09.866090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:09.866518 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:10.059041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:10.067808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-884fde06-5c77-4b7e-800c-54f03e417066 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.215998 Sep 01 09:13:10.068389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 156/310] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:09 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:10.635747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-61c3c3bb-916b-4788-9e18-9e6559aaba6a req-722189dc-0f73-49a8-a003-aca65f46c4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2092b30-2f77-4b50-bb12-b44b1c617a8b", "tag": "51eb69c5-37f3-419c-a79c-4ba4bbf3317b"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:10.638779 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:10.639639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:10.647215 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-61c3c3bb-916b-4788-9e18-9e6559aaba6a req-722189dc-0f73-49a8-a003-aca65f46c4cc service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:10.648153 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:10.648403 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-61c3c3bb-916b-4788-9e18-9e6559aaba6a req-722189dc-0f73-49a8-a003-aca65f46c4cc service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:10.648561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-61c3c3bb-916b-4788-9e18-9e6559aaba6a req-722189dc-0f73-49a8-a003-aca65f46c4cc service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:10.648788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:10.649534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:10.650417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:10.651043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:10.651876 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:10.660156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-61c3c3bb-916b-4788-9e18-9e6559aaba6a req-722189dc-0f73-49a8-a003-aca65f46c4cc service nova] Creating event network-changed:51eb69c5-37f3-419c-a79c-4ba4bbf3317b for instance a2092b30-2f77-4b50-bb12-b44b1c617a8b on hv-cinder-82002 Sep 01 09:13:10.665300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-61c3c3bb-916b-4788-9e18-9e6559aaba6a req-722189dc-0f73-49a8-a003-aca65f46c4cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034740 Sep 01 09:13:10.665988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 155/311] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:10.829304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:10.837352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-43800ca3-260c-44eb-bad7-3f9c118bf62c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.203481 Sep 01 09:13:10.838005 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 157/312] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:10 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:11.089018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:11.089704 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:11.098573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:11.098573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:11.098573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:11.099385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:11.099840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:11.105835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-05515416-bbae-46ff-8993-00014cfdfff8 req-9754c737-7aab-4260-b1ae-d4a63f8e1837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0760e1d-3d2e-4eae-b113-78ed44c4f6a4", "name": "network-vif-plugged", "status": "completed", "tag": "6fd3f0b1-2b81-45bc-8411-6aa0f55497df"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:11.111794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:11.115573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-05515416-bbae-46ff-8993-00014cfdfff8 req-9754c737-7aab-4260-b1ae-d4a63f8e1837 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:11.117731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-05515416-bbae-46ff-8993-00014cfdfff8 req-9754c737-7aab-4260-b1ae-d4a63f8e1837 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:11.117731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-05515416-bbae-46ff-8993-00014cfdfff8 req-9754c737-7aab-4260-b1ae-d4a63f8e1837 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:11.128358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-05515416-bbae-46ff-8993-00014cfdfff8 req-9754c737-7aab-4260-b1ae-d4a63f8e1837 service nova] Creating event network-vif-plugged:6fd3f0b1-2b81-45bc-8411-6aa0f55497df for instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 on hv-cinder-82002 Sep 01 09:13:11.134273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-05515416-bbae-46ff-8993-00014cfdfff8 req-9754c737-7aab-4260-b1ae-d4a63f8e1837 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Sep 01 09:13:11.135647 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 158/313] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:13:11.256340 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:11.264519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a4acebc8-4af7-4361-b5af-2dc8062b6673 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.179779 Sep 01 09:13:11.265428 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 156/314] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:11 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:11.858321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:11.859152 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:11.866449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:11.867052 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:11.867618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:11.868348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:11.868821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:11.869211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:11.997236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:12.006497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d2c7bbe3-839c-4d26-82be-a35d272c1060 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.152567 Sep 01 09:13:12.007417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 159/315] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:11 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:12.286643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:12.287283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:12.293312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:12.293799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:12.294233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:12.294918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:12.295654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:12.296078 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:12.435973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:12.444346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-886c0845-5dc8-425c-addb-3735806f1b7c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.161355 Sep 01 09:13:12.446938 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 157/316] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:12 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:13.027440 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:13.028082 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:13.034663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:13.035180 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:13.035595 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:13.036276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:13.036722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:13.037141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:13.168518 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:13.176882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-176950e8-e28c-4f6c-8d72-470bd5e75174 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.153288 Sep 01 09:13:13.177454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 160/317] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:13 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:13.464928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:13.465541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:13.472515 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:13.472990 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:13.473421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:13.474102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:13.474559 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:13.474972 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:13.602316 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:13.610836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-58d8ad56-69fb-4379-97f2-b0628ddbbd49 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.149603 Sep 01 09:13:13.611442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 158/318] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:13 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:14.199850 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:14.200455 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:14.207059 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:14.207599 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:14.208045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:14.208727 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:14.209183 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:14.209604 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:14.341103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:14.349348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d5337d4c-7f7f-4462-8ac7-9eb269a5812b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.153441 Sep 01 09:13:14.349919 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 161/319] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:14 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:14.632593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:14.633210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:14.639653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:14.640138 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:14.640579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:14.641267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:14.641727 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:14.642154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:14.770958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:14.778547 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-460703cc-8806-4b18-9dbe-597f53afcf07 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.149904 Sep 01 09:13:14.779125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 159/320] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:14 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:15.369671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:15.370277 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:15.376127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:15.376612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:15.377052 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:15.377738 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:15.378195 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:15.378621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:15.509451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:15.517290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-23dc2bbe-a6ed-4600-ad7c-60e856653959 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.151403 Sep 01 09:13:15.518065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 162/321] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:15 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:15.800386 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:15.801000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:15.807639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:15.808125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:15.808559 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:15.809244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:15.809700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:15.810125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:15.941653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:15.949290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-246a10a0-a0b8-4188-94b2-de1bc0a8cbc5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.153127 Sep 01 09:13:15.949850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 160/322] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:15 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:16.538117 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:16.538778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:16.544699 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:16.545425 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:16.545882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:16.546555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:16.546996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:16.547444 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:16.678191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:16.685827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a7a5ea26-e9aa-4922-98d2-2b49fab96018 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1370 microversion: 2.1 time: 0.151847 Sep 01 09:13:16.686799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 163/323] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:16 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:16.970753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:16.972118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:16.975743 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:16.976486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=12 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:16.981807 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:16.987022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:16.987022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:16.987022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:16.987022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:16.987390 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:17.120508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:17.128312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fa9f89e3-38ca-4867-ad4c-3075157189e4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.162320 Sep 01 09:13:17.128892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 161/324] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:16 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:17.708082 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:17.708881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:17.710913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:17.715691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:17.718139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:17.718139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:17.718139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:17.718139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:17.718520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:17.852105 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:17.860951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-267bf2ba-bb6f-47b3-bd5c-90b364fe7645 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1563 microversion: 2.1 time: 0.157482 Sep 01 09:13:17.861548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 164/325] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:17 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:17.882417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:17.882911 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:17.889076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:17.889567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:17.890007 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:17.890701 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:17.891193 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:17.891654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:17.975714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-683df24b-e2f5-4298-8aec-212eb0872a12 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095802 Sep 01 09:13:17.975714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 162/326] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:13:17 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:18.149853 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:18.150580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:18.157680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:18.158184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:18.158624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:18.159359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:18.159813 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:18.160239 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:18.542598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:18.555361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-508dbfe0-4cbc-463c-9a71-32afc570c73c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.409071 Sep 01 09:13:18.559972 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 165/327] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:18 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:19.266834 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-3abf10fd-09ce-484a-8b5c-35f68449efe0 req-fd472f79-d941-40c8-8c3a-05217f83302f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0760e1d-3d2e-4eae-b113-78ed44c4f6a4", "tag": "6fd3f0b1-2b81-45bc-8411-6aa0f55497df"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:19.277825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-3abf10fd-09ce-484a-8b5c-35f68449efe0 req-fd472f79-d941-40c8-8c3a-05217f83302f service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:19.278321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-3abf10fd-09ce-484a-8b5c-35f68449efe0 req-fd472f79-d941-40c8-8c3a-05217f83302f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:19.278967 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-3abf10fd-09ce-484a-8b5c-35f68449efe0 req-fd472f79-d941-40c8-8c3a-05217f83302f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:19.297748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-3abf10fd-09ce-484a-8b5c-35f68449efe0 req-fd472f79-d941-40c8-8c3a-05217f83302f service nova] Creating event network-changed:6fd3f0b1-2b81-45bc-8411-6aa0f55497df for instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 on hv-cinder-82002 Sep 01 09:13:19.303658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-3abf10fd-09ce-484a-8b5c-35f68449efe0 req-fd472f79-d941-40c8-8c3a-05217f83302f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040715 Sep 01 09:13:19.304561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 163/328] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:19.578507 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:19.579838 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:19.586741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:19.587268 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:19.587714 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:19.588420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:19.589026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:19.589461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:19.593751 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:19.893001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-20d42508-ddf5-472a-993b-6bcafc2bb9c8 req-bff19922-baad-4b9a-a2da-4f0d49341d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2092b30-2f77-4b50-bb12-b44b1c617a8b", "name": "network-vif-plugged", "status": "completed", "tag": "51eb69c5-37f3-419c-a79c-4ba4bbf3317b"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:19.903414 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-20d42508-ddf5-472a-993b-6bcafc2bb9c8 req-bff19922-baad-4b9a-a2da-4f0d49341d77 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:19.904137 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-20d42508-ddf5-472a-993b-6bcafc2bb9c8 req-bff19922-baad-4b9a-a2da-4f0d49341d77 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:19.904801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-20d42508-ddf5-472a-993b-6bcafc2bb9c8 req-bff19922-baad-4b9a-a2da-4f0d49341d77 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:19.917848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-20d42508-ddf5-472a-993b-6bcafc2bb9c8 req-bff19922-baad-4b9a-a2da-4f0d49341d77 service nova] Creating event network-vif-plugged:51eb69c5-37f3-419c-a79c-4ba4bbf3317b for instance a2092b30-2f77-4b50-bb12-b44b1c617a8b on hv-cinder-82002 Sep 01 09:13:19.923557 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-20d42508-ddf5-472a-993b-6bcafc2bb9c8 req-bff19922-baad-4b9a-a2da-4f0d49341d77 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034987 Sep 01 09:13:19.929087 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 164/329] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:13:19.934565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:19.943705 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fc863c97-1f73-4dec-8fcb-b80fba0596f1 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.369508 Sep 01 09:13:19.944420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 166/330] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:19 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:20.964703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:20.965399 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:20.972252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:20.972834 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:20.973359 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:20.974008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:20.974457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:20.974889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:21.106597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:21.119148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c30cd0c8-d512-406e-bf77-7f2acaa4d6f4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.155776 Sep 01 09:13:21.119148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 165/331] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:20 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:22.136640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:22.137188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:22.143238 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:22.155597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:22.155597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:22.155597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:22.155597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:22.156035 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:22.282582 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:22.290640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8453840c-7030-4110-8fd6-74d6db9a810c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1313 microversion: 2.1 time: 0.157955 Sep 01 09:13:22.291217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 167/332] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:22 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:23.311473 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:23.312083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:23.319373 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:23.319856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:23.320291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:23.320974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:23.321427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:23.321851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:23.451725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:23.459639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e838961e-eebc-47e2-b7ac-d3bec85dc305 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1496 microversion: 2.1 time: 0.151933 Sep 01 09:13:23.460203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 166/333] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:23 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:24.574901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:24.574901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:24.580915 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:24.581400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:24.581839 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:24.582526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:24.582984 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:24.583443 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:24.609120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:13:24.875324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-af3466e8-4432-44e3-a30e-4ef881b7b111 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 204 len: 0 microversion: 2.1 time: 0.304384 Sep 01 09:13:24.875962 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 168/334] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:13:24 2022] DELETE /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 09:13:24.884012 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:24.884654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:24.891086 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:24.891592 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:24.892027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:24.892752 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:24.893218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:24.893643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:24.898291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:25.023941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:25.031657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0bc6a8a2-c441-4068-8052-9096db721e70 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1502 microversion: 2.1 time: 0.151428 Sep 01 09:13:25.032228 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 167/335] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:24 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:26.053407 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:26.054245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:26.056564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:26.061207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:26.061686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:26.062116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:26.062902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:26.063401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:26.063824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:26.197573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:26.205173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-24f41ef2-37b1-4c01-96bf-10c0df57dd9c tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1502 microversion: 2.1 time: 0.155960 Sep 01 09:13:26.205744 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 169/336] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:26 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:27.227013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:27.227727 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:27.234763 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:27.235320 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:27.235785 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:27.236484 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:27.236947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:27.237462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:27.327551 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:27.341392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-8935faf1-f734-4431-9c1c-0c9d87f4d4c7 req-7cb4b74f-f803-494c-b96e-f3abbdd81233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2092b30-2f77-4b50-bb12-b44b1c617a8b", "name": "network-vif-deleted", "tag": "51eb69c5-37f3-419c-a79c-4ba4bbf3317b"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:27.341923 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0470d85b-e40e-4615-a9cc-2e463fec5215 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1460 microversion: 2.1 time: 0.119194 Sep 01 09:13:27.342217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 168/337] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:27 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1460 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:27.351016 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-8935faf1-f734-4431-9c1c-0c9d87f4d4c7 req-7cb4b74f-f803-494c-b96e-f3abbdd81233 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:27.351825 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-8935faf1-f734-4431-9c1c-0c9d87f4d4c7 req-7cb4b74f-f803-494c-b96e-f3abbdd81233 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:27.352338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-8935faf1-f734-4431-9c1c-0c9d87f4d4c7 req-7cb4b74f-f803-494c-b96e-f3abbdd81233 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:27.362991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-8935faf1-f734-4431-9c1c-0c9d87f4d4c7 req-7cb4b74f-f803-494c-b96e-f3abbdd81233 service nova] Creating event network-vif-deleted:51eb69c5-37f3-419c-a79c-4ba4bbf3317b for instance a2092b30-2f77-4b50-bb12-b44b1c617a8b on hv-cinder-82002 Sep 01 09:13:27.368807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-8935faf1-f734-4431-9c1c-0c9d87f4d4c7 req-7cb4b74f-f803-494c-b96e-f3abbdd81233 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 Sep 01 09:13:27.369414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 170/338] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:13:28.362608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:28.363163 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:28.370067 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:28.370550 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:28.370980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:28.371715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:28.372169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:28.372620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:28.402529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:28.402997 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:28.403461 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:28.403892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lazy-loading 'fault' on Instance uuid a2092b30-2f77-4b50-bb12-b44b1c617a8b {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:13:28.449365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:28.457110 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0fdbca49-47a3-4b5a-829f-40f9a9a6f6cd tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 200 len: 1303 microversion: 2.1 time: 0.098365 Sep 01 09:13:28.457678 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 169/339] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:28 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:29.478748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:29.479390 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: a2092b30-2f77-4b50-bb12-b44b1c617a8b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:29.485596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:29.486081 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:29.486515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:29.487233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:29.487689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:29.488110 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:29.501396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] HTTP exception thrown: Instance a2092b30-2f77-4b50-bb12-b44b1c617a8b could not be found. Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Request method failure captured: Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b HTTP/1.1 Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHefIsOPZonwwlJ36q2tfJ7C_nQe1EHM6lNEkNzhFST3yYcmxvz-0rvCM_c8Xjuk0THZ_FwfALmkYSnZFmoEBFF1GqLdMeyjd71Z35pkGRAyVCF2tCXUis6maLVmdTZwrRzHyILLSjHJ8ns2d_YTAIbM1DH222YLi0eJEawOsqmul5M Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 79d23226b59c44f7bd30d9386494f4b3 Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesActionsTest-1094631879 Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:13:29.502988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79d23226b59c44f7bd30d9386494f4b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79d23226b59c44f7bd30d9386494f4b3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79d23226b59c44f7bd30d9386494f4b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79d23226b59c44f7bd30d9386494f4b3"}]}] Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesActionsTest-1094631879 Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 79d23226b59c44f7bd30d9386494f4b3 Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesActionsTest-1094631879 Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesActionsTest-1094631879-project Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 602d298896d643a098bcbc1853dddbb7 Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesActionsTest-1094631879-project Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance a2092b30-2f77-4b50-bb12-b44b1c617a8b could not be found. Sep 01 09:13:29.504527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'a2092b30-2f77-4b50-bb12-b44b1c617a8b'} Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2092b30-2f77-4b50-bb12-b44b1c617a8b could not be found. Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:13:29.505370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2092b30-2f77-4b50-bb12-b44b1c617a8b could not be found. Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2092b30-2f77-4b50-bb12-b44b1c617a8b could not be found. Sep 01 09:13:29.506627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:13:29.508255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Returning 404 to user: Instance a2092b30-2f77-4b50-bb12-b44b1c617a8b could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:13:29.508255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d639519c-8f43-4691-90b1-8a63c13d3b40 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b" status: 404 len: 111 microversion: 2.1 time: 0.030366 Sep 01 09:13:29.508255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 171/340] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:29 2022] GET /compute/v2.1/servers/a2092b30-2f77-4b50-bb12-b44b1c617a8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:13:29.555512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1259839836", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "networks": [{"uuid": "5c7dd9f9-ad93-443c-b721-1a4810263c92"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:29.608942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] validate_networks() for [('5c7dd9f9-ad93-443c-b721-1a4810263c92', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:13:29.953393 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:13:29.953819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:13:29.954301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:13:29.954711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:13:29.955148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:13:29.965704 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:29.966376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:29.967078 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:29.967988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:29.968648 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:29.969290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:29.986685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Getting quotas for project 79d23226b59c44f7bd30d9386494f4b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:13:29.990491 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Getting quotas for user 602d298896d643a098bcbc1853dddbb7 and project 79d23226b59c44f7bd30d9386494f4b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:13:30.002016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:13:30.004321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:13:30.117909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cab78069-78b6-4c39-99ba-07ccee465cfe tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565745 Sep 01 09:13:30.118786 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 170/341] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:13:30.134198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-19c62039-8cb6-4073-83da-19dbf6297bc2 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:30.134821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-19c62039-8cb6-4073-83da-19dbf6297bc2 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:30.188493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-19c62039-8cb6-4073-83da-19dbf6297bc2 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:30.195981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-19c62039-8cb6-4073-83da-19dbf6297bc2 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1214 microversion: 2.1 time: 0.066055 Sep 01 09:13:30.196560 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 172/342] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:30 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:31.218192 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:31.218707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:31.224878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:31.225360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:31.225796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:31.226608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:31.227265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:31.227701 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:31.289463 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:31.297504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-aca38159-5865-42dd-b6e5-0aa84c6d767d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1218 microversion: 2.1 time: 0.083795 Sep 01 09:13:31.298081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 171/343] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:31 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:32.317863 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:32.318655 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:32.325824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:32.326330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:32.326770 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:32.327522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:32.327981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:32.328408 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:32.394626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:32.403598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b2047678-2c48-45e9-b106-e3ff89893b66 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1274 microversion: 2.1 time: 0.089605 Sep 01 09:13:32.404173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 173/344] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:32 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:33.425071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:33.425675 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:33.433200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:33.434280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:33.434723 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:33.435439 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:33.435950 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:33.436375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:33.583140 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:33.591809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d0562d29-c2ef-42fa-896f-dc423d33fb4e tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.170829 Sep 01 09:13:33.592383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 172/345] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:33 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:33.892397 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-41501f88-2b47-43b3-83db-bc4680aa5323 req-82a98346-59f9-4152-a835-a5b8409343de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688c4192-467e-4568-a333-0b65f3edc9e8", "tag": "0df218f4-d338-4acf-8455-594678f98eff"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:33.902865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-41501f88-2b47-43b3-83db-bc4680aa5323 req-82a98346-59f9-4152-a835-a5b8409343de service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:33.903389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-41501f88-2b47-43b3-83db-bc4680aa5323 req-82a98346-59f9-4152-a835-a5b8409343de service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:33.903818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-41501f88-2b47-43b3-83db-bc4680aa5323 req-82a98346-59f9-4152-a835-a5b8409343de service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:33.914359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-41501f88-2b47-43b3-83db-bc4680aa5323 req-82a98346-59f9-4152-a835-a5b8409343de service nova] Creating event network-changed:0df218f4-d338-4acf-8455-594678f98eff for instance 688c4192-467e-4568-a333-0b65f3edc9e8 on hv-cinder-82002 Sep 01 09:13:33.919507 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-41501f88-2b47-43b3-83db-bc4680aa5323 req-82a98346-59f9-4152-a835-a5b8409343de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030818 Sep 01 09:13:33.920090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 174/346] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:34.613310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:34.613922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:34.620825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:34.621289 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:34.622004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:34.622731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:34.623234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:34.623660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:34.793262 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:34.796555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-794349ad-31e9-466f-89c4-d5d4197eaaa4 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.186915 Sep 01 09:13:34.797130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 173/347] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:34 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:35.818475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:35.819090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:35.825840 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:35.826322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:35.826756 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:35.827471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:35.827928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:35.828350 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:35.956128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:35.963765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c2547959-c7d4-409b-9ce8-d66ea5a97ce5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.149647 Sep 01 09:13:35.964337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 175/348] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:35 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:36.984435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:36.984977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:36.991376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:36.991862 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:36.992297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:36.993202 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:36.993654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:36.994076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:37.117922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:37.125535 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fe998e86-5bf6-49db-ab8f-1d993ccb14fa tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.145089 Sep 01 09:13:37.126095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 174/349] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:36 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:38.146139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:38.146832 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:38.153713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:38.154192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:38.154627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:38.155338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:38.155793 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:38.156222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:38.285855 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:38.293526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-eb20bb62-8870-40ca-8636-227a395954f3 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.151309 Sep 01 09:13:38.294089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 176/350] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:38 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:39.055377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:39.056031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:39.058185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:39.062892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:39.063358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:39.063803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:39.064583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:39.064937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:39.066611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:39.091784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fbec60bf-6c38-4b62-bec8-ac0de988f422 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/ips" status: 200 len: 148 microversion: 2.1 time: 0.040210 Sep 01 09:13:39.092376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 175/351] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:13:39 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:39.315209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:39.315854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:39.321939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:39.322524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:39.323033 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:39.323812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:39.324345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:39.324993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:39.458172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:39.466935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2ca6833e-8829-48df-8688-bad3c41d7602 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.155668 Sep 01 09:13:39.467673 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 177/352] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:39 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:40.547263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:40.547885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:40.549865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:40.550640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:40.556273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:40.556760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:40.557198 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:40.557900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:40.558364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:40.558796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:40.687694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:40.695306 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-aa3e72c3-4bbb-4997-9a87-1e152ec915d6 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.152545 Sep 01 09:13:40.695877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 176/353] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:40 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:41.716922 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:41.717534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:41.719576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:41.724265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:41.724753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:41.725190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:41.725872 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:41.726330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:41.726782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:41.776826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-01e79f38-64bf-439b-b55f-1aac3ecd0e42 req-6e4bd88b-17e8-4f3c-aad6-6550ea758e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c4192-467e-4568-a333-0b65f3edc9e8", "name": "network-vif-plugged", "status": "completed", "tag": "0df218f4-d338-4acf-8455-594678f98eff"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:41.787935 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-01e79f38-64bf-439b-b55f-1aac3ecd0e42 req-6e4bd88b-17e8-4f3c-aad6-6550ea758e19 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:41.788481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-01e79f38-64bf-439b-b55f-1aac3ecd0e42 req-6e4bd88b-17e8-4f3c-aad6-6550ea758e19 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:41.788925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-01e79f38-64bf-439b-b55f-1aac3ecd0e42 req-6e4bd88b-17e8-4f3c-aad6-6550ea758e19 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:41.801371 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-01e79f38-64bf-439b-b55f-1aac3ecd0e42 req-6e4bd88b-17e8-4f3c-aad6-6550ea758e19 service nova] Creating event network-vif-plugged:0df218f4-d338-4acf-8455-594678f98eff for instance 688c4192-467e-4568-a333-0b65f3edc9e8 on hv-cinder-82002 Sep 01 09:13:41.806580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-01e79f38-64bf-439b-b55f-1aac3ecd0e42 req-6e4bd88b-17e8-4f3c-aad6-6550ea758e19 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034462 Sep 01 09:13:41.807696 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 177/354] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:13:41.867727 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:41.876522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-297e0cc8-3436-464a-b7bd-4b7a607a7f23 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.164062 Sep 01 09:13:41.877323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 178/355] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:41 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:41.943449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fea40e3-9c09-47f7-afe9-a3a96752aed4"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:41.945905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:41.952173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:41.952652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:41.953080 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:41.953765 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:41.954211 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:41.954629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:42.800062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6406e322-d883-484b-bb69-3dcfd6e10307 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860677 Sep 01 09:13:42.800778 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 178/356] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:13:41 2022] POST /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:42.896975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:42.897579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:42.904082 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:42.904560 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:42.904990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:42.905667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:42.906115 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:42.906533 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:43.034595 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:43.042114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8c81d8e7-0fee-4651-8721-bf1e3185f029 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.148919 Sep 01 09:13:43.042687 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 179/357] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:42 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:44.063801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:44.064493 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:44.071401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:44.071889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:44.072326 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:44.073015 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:44.073508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:44.073931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:44.206293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:44.213982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ba71ec19-7bab-4b34-bb16-7c37d32f695a tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1314 microversion: 2.1 time: 0.154611 Sep 01 09:13:44.214555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 179/358] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:44 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:45.235819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:45.236423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:45.238652 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:13:45.238798 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Thu Sep 1 09:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 (ip 10.222.0.46) !!! Sep 01 09:13:45.245263 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:45.246573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:45.246573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:45.246817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:45.247298 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:45.247718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:45.380097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:45.387720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f421230a-1b00-43ce-8f8d-9ed1c8267aba tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1498 microversion: 2.1 time: 0.156293 Sep 01 09:13:45.388344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 180/359] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:45 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:46.302585 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:46.303141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:46.309818 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:46.310307 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:46.310749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:46.311469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:46.311930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:46.312363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:46.338880 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:13:46.655722 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0c2e6ef4-c244-4a27-a211-f8dbd8e5b0b5 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 204 len: 0 microversion: 2.1 time: 0.356606 Sep 01 09:13:46.656598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 180/360] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:13:46 2022] DELETE /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:13:46.664655 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:46.665290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:46.671777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:46.673441 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:46.674417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:46.674734 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:46.675230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:46.675687 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:46.861605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:46.869342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1a53e4e7-07a6-4267-a43a-69e7b9f1e021 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1504 microversion: 2.1 time: 0.208585 Sep 01 09:13:46.869997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 181/361] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:46 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:47.890817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:47.891518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:47.898269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:47.898754 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:47.899221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:47.899922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:47.900407 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:47.900837 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:48.032772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:48.040577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0dd8bee7-199b-454f-839d-e9dff5a2d7ec tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1504 microversion: 2.1 time: 0.154346 Sep 01 09:13:48.041148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 181/362] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:47 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:49.029703 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:49.030251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:49.036286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:49.036777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:49.037219 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:49.037920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:49.038380 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:49.038810 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:49.062227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:49.064115 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:49.064894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0242770f-6639-4c0e-aef9-bcada0a51a0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/ips" status: 200 len: 151 microversion: 2.20 time: 0.038950 Sep 01 09:13:49.065791 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 182/363] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Sep 1 09:13:49 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:13:49.070877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:49.071924 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:49.072531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:49.073231 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:49.073711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:49.074297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:49.080038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:49.263540 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:49.280417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b84bda34-4b01-417a-bf4a-f16e2ec77c5d tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1504 microversion: 2.1 time: 0.222270 Sep 01 09:13:49.283537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 182/364] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:49 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:49.319081 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-bd27e327-144c-45c4-b597-2a2e64e53e5a req-685708c5-d1d7-4cff-b2bf-4b0e23979048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c4192-467e-4568-a333-0b65f3edc9e8", "name": "network-vif-deleted", "tag": "0df218f4-d338-4acf-8455-594678f98eff"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:49.328298 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-bd27e327-144c-45c4-b597-2a2e64e53e5a req-685708c5-d1d7-4cff-b2bf-4b0e23979048 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:49.328776 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-bd27e327-144c-45c4-b597-2a2e64e53e5a req-685708c5-d1d7-4cff-b2bf-4b0e23979048 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:49.329225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-bd27e327-144c-45c4-b597-2a2e64e53e5a req-685708c5-d1d7-4cff-b2bf-4b0e23979048 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:49.340122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-bd27e327-144c-45c4-b597-2a2e64e53e5a req-685708c5-d1d7-4cff-b2bf-4b0e23979048 service nova] Creating event network-vif-deleted:0df218f4-d338-4acf-8455-594678f98eff for instance 688c4192-467e-4568-a333-0b65f3edc9e8 on hv-cinder-82002 Sep 01 09:13:49.345871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-bd27e327-144c-45c4-b597-2a2e64e53e5a req-685708c5-d1d7-4cff-b2bf-4b0e23979048 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030361 Sep 01 09:13:49.346531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 183/365] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:50.304189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:50.304796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:50.311423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:50.311912 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:50.312377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:50.313069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:50.314383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:50.314808 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:50.345128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:50.345604 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:50.346036 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:50.346473 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lazy-loading 'fault' on Instance uuid 688c4192-467e-4568-a333-0b65f3edc9e8 {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:13:50.388828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:50.396397 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-57ffb945-c076-4963-9173-3f49288558ac tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1304 microversion: 2.1 time: 0.096620 Sep 01 09:13:50.396964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 183/366] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:50 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:50.797352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1038724776", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:50.849276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] validate_networks() for None {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:13:51.117980 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:13:51.118397 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:13:51.118865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:13:51.119301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:13:51.119711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:13:51.128537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:51.129011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:51.129767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:51.130481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:51.130928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:51.131449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:51.138016 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:51.148795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Getting quotas for project 4299d4d3bdaf4d97908a7e404f99d815. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:13:51.153433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Getting quotas for user 0f3c9be876d64ece967dc67974d600fa and project 4299d4d3bdaf4d97908a7e404f99d815. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:13:51.165594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:13:51.177914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:13:51.329165 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-916a47af-090a-4bad-aa8b-c72679c77da5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536027 Sep 01 09:13:51.330339 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 184/367] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:13:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:13:51.349346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c81be362-4504-4047-be20-d51bffa6d937 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:51.350123 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c81be362-4504-4047-be20-d51bffa6d937 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:51.404314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c81be362-4504-4047-be20-d51bffa6d937 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:51.411788 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c81be362-4504-4047-be20-d51bffa6d937 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1215 microversion: 2.1 time: 0.066663 Sep 01 09:13:51.412469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 184/368] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:51 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:51.420232 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:51.420905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:51.429589 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:51.430089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:51.431133 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:51.432166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:51.432782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:51.433363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:51.468828 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:51.469438 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:51.469863 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:51.470458 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lazy-loading 'fault' on Instance uuid 688c4192-467e-4568-a333-0b65f3edc9e8 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:13:51.518796 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602d298896d643a098bcbc1853dddbb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d23226b59c44f7bd30d9386494f4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:51.527023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b5b50c46-70a1-446c-b762-b61852fb4047 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 200 len: 1304 microversion: 2.1 time: 0.113539 Sep 01 09:13:51.527636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 185/369] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:51 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:52.434050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:52.434673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:52.439369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b104674d-a7a2-4b16-a0b1-f6ab4094da7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: .version_select at 0x7f7a65651ca0>, body: {"keypair": {"name": "tempest-keypair-73024492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdZj6PdCLwOlrcWtV8nlB2u8pP5nqPDZj9riPTopQsmHCQd3VnSXj6zM1uEVK1LchKYt1ua1HHwfU7c8i6gKgXfK7HqLeJC4gsOeg4ccYw6dyRsLLOy5bcsTF6BYTqbjQ=="}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:52.442677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:52.443204 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:52.443650 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:52.444534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:52.444991 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:52.450567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:52.456599 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-b104674d-a7a2-4b16-a0b1-f6ab4094da7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:13:52.460611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-b104674d-a7a2-4b16-a0b1-f6ab4094da7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:13:52.511661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:52.519325 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-726e6f87-f683-4cc1-a000-377f477da898 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1219 microversion: 2.1 time: 0.089377 Sep 01 09:13:52.520575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 185/370] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:52 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:52.548787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:52.549656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] [instance: 688c4192-467e-4568-a333-0b65f3edc9e8] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:52.556212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b104674d-a7a2-4b16-a0b1-f6ab4094da7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.121113 Sep 01 09:13:52.557000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:52.557108 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 186/371] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:13:52 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:13:52.557316 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:52.557826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:52.558533 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:52.558989 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:52.559462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:52.576232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] HTTP exception thrown: Instance 688c4192-467e-4568-a333-0b65f3edc9e8 could not be found. Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Request method failure captured: Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 HTTP/1.1 Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHefIsOPZonwwlJ36q2tfJ7C_nQe1EHM6lNEkNzhFST3yYcmxvz-0rvCM_c8Xjuk0THZ_FwfALmkYSnZFmoEBFF1GqLdMeyjd71Z35pkGRAyVCF2tCXUis6maLVmdTZwrRzHyILLSjHJ8ns2d_YTAIbM1DH222YLi0eJEawOsqmul5M Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 79d23226b59c44f7bd30d9386494f4b3 Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-VolumesActionsTest-1094631879 Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:13:52.578433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79d23226b59c44f7bd30d9386494f4b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79d23226b59c44f7bd30d9386494f4b3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79d23226b59c44f7bd30d9386494f4b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79d23226b59c44f7bd30d9386494f4b3"}]}] Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-VolumesActionsTest-1094631879 Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 79d23226b59c44f7bd30d9386494f4b3 Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-VolumesActionsTest-1094631879 Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-VolumesActionsTest-1094631879-project Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 602d298896d643a098bcbc1853dddbb7 Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-VolumesActionsTest-1094631879-project Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 688c4192-467e-4568-a333-0b65f3edc9e8 could not be found. Sep 01 09:13:52.583440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '688c4192-467e-4568-a333-0b65f3edc9e8'} Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688c4192-467e-4568-a333-0b65f3edc9e8 could not be found. Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:13:52.584203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688c4192-467e-4568-a333-0b65f3edc9e8 could not be found. Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688c4192-467e-4568-a333-0b65f3edc9e8 could not be found. Sep 01 09:13:52.585395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:13:52.586465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] Returning 404 to user: Instance 688c4192-467e-4568-a333-0b65f3edc9e8 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:13:52.586465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7c0d8973-67d1-4d48-afb1-4d2cb2255995 tempest-VolumesActionsTest-1094631879 tempest-VolumesActionsTest-1094631879-project] 10.222.0.46 "GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8" status: 404 len: 111 microversion: 2.1 time: 0.035755 Sep 01 09:13:52.586465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 186/372] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:52 2022] GET /compute/v2.1/servers/688c4192-467e-4568-a333-0b65f3edc9e8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 09:13:52.738025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:52.738542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:52.748515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:52.748515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:52.748515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:52.748515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:52.749003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:52.749003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:52.779069 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lazy-loading 'flavor' on Instance uuid 2cfa76cf-89f5-4112-a5ae-859e051bbe0d {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:13:53.423498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-76a251f6-d781-4166-a162-d45fd94b5941 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/action" status: 202 len: 0 microversion: 2.20 time: 0.689425 Sep 01 09:13:53.424570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 187/373] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Sep 1 09:13:52 2022] POST /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:13:53.438847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:53.439588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:53.446751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:53.447347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:53.447871 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:53.448623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:53.449196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:53.449683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:53.540891 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:53.541616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:53.548339 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:53.553357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:53.553357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:53.553357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:53.553357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:53.553685 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:53.591499 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:53.600548 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:53.602007 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:53.603210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-06fda479-6d74-4d95-bdca-f3c441489c7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.168915 Sep 01 09:13:53.603770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 187/374] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:13:53 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:13:53.667953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:53.678674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8204897e-bd86-4d6d-a24b-4848ef797bbb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1267 microversion: 2.1 time: 0.141734 Sep 01 09:13:53.680007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 188/375] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:53 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:54.625877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:54.626493 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:54.633979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:54.634473 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:54.634913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:54.635639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:54.636102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:54.636538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:54.706735 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:54.706735 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:54.710742 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:54.711337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:54.711848 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:54.712635 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:54.713167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:54.713713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:54.795400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:54.802127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6af45d32-c28b-4baf-834c-d9b57a12a8c5 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1273 microversion: 2.1 time: 0.104736 Sep 01 09:13:54.802712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 189/376] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:54 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:54.861843 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:54.871744 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:54.873223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:54.874405 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f81aadef-cf54-458f-a117-0a2216d30164 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.252433 Sep 01 09:13:54.878947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 188/377] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:13:54 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:13:55.172552 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-201443717", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d95d47db-eb5b-4df8-8295-e8765bcebf85"}], "security_groups": [{"name": "tempest-securitygroup--1569090987"}], "key_name": "tempest-keypair-73024492", "user_data": "}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:55.288054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] validate_networks() for [('d95d47db-eb5b-4df8-8295-e8765bcebf85', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:13:55.824161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:55.824777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:55.831440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:55.831944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:55.832384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:55.833101 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:55.833551 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:55.833981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:55.897052 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:13:55.897494 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:13:55.897961 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:13:55.898367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:13:55.898783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:13:55.907652 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:55.908134 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:55.909056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:55.909867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:55.910325 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:55.910746 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:55.928516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:13:55.932574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:13:55.943666 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:13:55.945952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:13:55.962525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:55.970228 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-bb0a2213-d378-497a-b213-8ea581eb8334 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.149967 Sep 01 09:13:55.971356 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 189/378] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:55 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:55.975739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:55.976354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:55.981910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:55.982396 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:55.982839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:55.983553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:55.984016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:55.984443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:56.085453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6071c02a-7824-4cab-8f7c-c41e3d433db1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917230 Sep 01 09:13:56.086343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 190/379] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:13:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:13:56.097918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d495847d-d37d-4492-8d0e-ddb2ba344a4e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:56.098817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d495847d-d37d-4492-8d0e-ddb2ba344a4e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:56.122161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:56.130588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:56.132062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:56.133233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e240126d-300d-45f2-9d4f-8e9a818e0d51 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.160961 Sep 01 09:13:56.133787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 190/380] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:13:55 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:13:56.154649 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d495847d-d37d-4492-8d0e-ddb2ba344a4e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:56.160546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d495847d-d37d-4492-8d0e-ddb2ba344a4e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1239 microversion: 2.1 time: 0.067195 Sep 01 09:13:56.161114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 191/381] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:56 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:56.992379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:56.993026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:56.999654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:57.000135 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:57.000568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:57.001252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:57.001704 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:57.003357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:57.155929 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:57.156538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:57.159312 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:13:57.164011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:57.164501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:57.164946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:57.165635 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:57.166087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:57.166512 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:57.242590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:57.251065 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-581cdcf6-09e6-4305-abaf-af66acbfea61 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.262343 Sep 01 09:13:57.252102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 191/382] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:56 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:57.257446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:57.258061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:57.264199 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:57.264863 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:57.265461 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:57.266446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:57.267066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:57.267680 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:57.305017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:57.313657 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:57.315154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:57.316340 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2d32dbec-a4c0-4f52-8409-840dac8bc94a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.164311 Sep 01 09:13:57.317093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 192/383] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:13:57 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:13:57.355457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:57.363968 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-27cb791e-6002-4eae-a30f-0f879bfacd6e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1243 microversion: 2.1 time: 0.110056 Sep 01 09:13:57.364840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 192/384] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:57 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1243 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:57.733432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-fb7d300e-b304-4fa3-9ea0-4522f33220c6 req-b5f90b4a-b48f-4942-be80-ae592f6f03a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac83a3c-c919-4dbb-a392-fd9459442d2a", "tag": "98574c41-a06d-4fbc-920f-cf631757e699"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:13:57.743249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-fb7d300e-b304-4fa3-9ea0-4522f33220c6 req-b5f90b4a-b48f-4942-be80-ae592f6f03a3 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:57.743730 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-fb7d300e-b304-4fa3-9ea0-4522f33220c6 req-b5f90b4a-b48f-4942-be80-ae592f6f03a3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:57.744162 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-fb7d300e-b304-4fa3-9ea0-4522f33220c6 req-b5f90b4a-b48f-4942-be80-ae592f6f03a3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:57.755250 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-fb7d300e-b304-4fa3-9ea0-4522f33220c6 req-b5f90b4a-b48f-4942-be80-ae592f6f03a3 service nova] Creating event network-changed:98574c41-a06d-4fbc-920f-cf631757e699 for instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a on hv-cinder-82002 Sep 01 09:13:57.759939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-fb7d300e-b304-4fa3-9ea0-4522f33220c6 req-b5f90b4a-b48f-4942-be80-ae592f6f03a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030112 Sep 01 09:13:57.760534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 193/385] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:57.994221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:57.994721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:58.001025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.001508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.001941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.002974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.003462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.003891 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.027308 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-23819f4e-ac55-408b-9527-8c4e652abe9b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/ips" status: 200 len: 146 microversion: 2.1 time: 0.037007 Sep 01 09:13:58.027870 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 193/386] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:13:57 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:13:58.273634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:58.274365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:58.280520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.281001 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.281463 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.282147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.282601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.283023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.339434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:58.346019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:58.346155 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.346630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.347207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.347901 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.348360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.348850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.430825 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:58.438986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e0a625d3-b6ea-46f2-a3cd-7cda53e23acb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.169419 Sep 01 09:13:58.451051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 194/387] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:58 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:58.458033 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:58.458774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:58.467212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.467212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.467212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.467502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:58.467849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:58.468273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:58.537846 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:58.546399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-39fa518b-bf88-4e8c-89b4-4fbf98bca6d9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1243 microversion: 2.1 time: 0.094186 Sep 01 09:13:58.546971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 195/388] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:58 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:58.583893 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:58.591886 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:58.593303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:58.594658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1dd1dffd-8539-455a-9901-53d89f4a4f46 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.259167 Sep 01 09:13:58.595242 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 194/389] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:13:58 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:13:59.466741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:59.466741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:59.471706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:59.472187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:59.472616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:59.473295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:59.473774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:59.474200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:59.568332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:59.568961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:59.575249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:59.575731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:59.576327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:59.577177 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:59.577788 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:59.578368 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:59.607525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:59.617076 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b282c7ae-8ed8-4131-b9d2-8c3d37adb089 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.155679 Sep 01 09:13:59.617660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 196/390] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:59 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:13:59.622446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:13:59.623131 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:13:59.629564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:59.630054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:59.630494 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:59.631224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:13:59.631675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:13:59.632110 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:13:59.647219 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:59.654721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0a6afde3-f1db-416c-8b90-9cf5a9146177 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1291 microversion: 2.1 time: 0.091558 Sep 01 09:13:59.655322 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 195/391] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:13:59 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1291 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:13:59.763389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:59.772416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:59.773934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:13:59.775065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f701a3c9-6bd6-44cf-80c9-5a1a72456b84 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.156504 Sep 01 09:13:59.775652 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 197/392] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:13:59 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:00.641913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:00.643282 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:00.652132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:00.652738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:00.653186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:00.654161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:00.654703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:00.655358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:00.676947 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:00.677556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:00.686493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:00.687366 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:00.688103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:00.689046 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:00.690406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:00.691127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:00.763356 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:00.773447 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2e845c5c-9905-47ba-80b0-d838aa4d085e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1291 microversion: 2.1 time: 0.101538 Sep 01 09:14:00.787967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 198/393] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:00 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1291 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:00.798010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:00.798620 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:00.805420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:00.805910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:00.806353 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:00.807554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:00.807554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:00.807949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:00.821284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:00.829462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9f7fdb00-2020-4d70-8f1e-293062cf3829 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.193640 Sep 01 09:14:00.831051 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 196/394] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:00 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:00.958228 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:00.967673 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:00.969209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:00.970471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3449a92e-550a-424c-8cba-454ea38a3563 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.176617 Sep 01 09:14:00.989639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 199/395] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:00 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:14:01.671379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bac51459-8956-453f-8365-f29e35df5bc9"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:01.674508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:01.677875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:01.682303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:01.683043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:01.683572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:01.684608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:01.685159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:01.685961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:01.796323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:01.797869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:01.804669 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:01.805152 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:01.805784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:01.806474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:01.807121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:01.807549 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:01.891680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:01.903228 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d7a10c97-8453-4d34-a717-8b84db8e409c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1291 microversion: 2.1 time: 0.110515 Sep 01 09:14:01.904184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 200/396] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:01 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1291 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:01.910592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:01.911313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:01.951940 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:01.951940 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:01.951940 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:01.951940 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:01.952592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:01.952592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:02.103545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:02.115270 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b76c3496-2bdb-44bd-b6a4-b07a464c87eb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.209484 Sep 01 09:14:02.116078 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 201/397] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:01 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:02.121033 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:02.122223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:02.130597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:02.131399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:02.132055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:02.132761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:02.133221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:02.133718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:02.157127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:02.296646 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:02.305960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:02.307437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:02.308743 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cce37764-0373-4ee8-afd4-07f12e284e27 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.191379 Sep 01 09:14:02.320001 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 202/398] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:02 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:02.928424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:02.929913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:02.937268 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:02.937871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:02.938377 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:02.939340 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:02.940612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:02.941045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:03.028995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:03.037651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-eeb65cc3-a071-4433-b713-29634098aa48 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1291 microversion: 2.1 time: 0.115990 Sep 01 09:14:03.039126 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 203/399] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:02 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1291 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:03.138877 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:03.139997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:03.146808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:03.147329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:03.151097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:03.152572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:03.153417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:03.154212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:03.336380 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:03.348117 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-703bbad8-d892-45d1-a9e3-a8739da82dcb tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.213823 Sep 01 09:14:03.369720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 204/400] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:03 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:03.375593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:03.376516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:03.385244 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:03.386093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:03.387337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:03.388247 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:03.388715 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:03.389598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:03.628867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:03.645809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:03.650857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:03.654625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e986f61d-38c2-47c7-8f8a-fa7af3506eef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.292669 Sep 01 09:14:03.655469 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 205/401] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:03 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:03.680908 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a1ea9f3d-f588-4ef6-be57-dfe9a195f691 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.013644 Sep 01 09:14:03.682838 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 197/402] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:14:01 2022] POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-volume_attachments => generated 194 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:04.060402 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:04.061915 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:04.069669 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:04.070398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:04.071026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:04.072136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:04.072817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:04.073424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:04.154066 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:04.162683 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2827ddff-e7a3-4c72-a11e-2e903eb4b827 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1297 microversion: 2.1 time: 0.106574 Sep 01 09:14:04.164397 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 206/403] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:04 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:04.378819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:04.379582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:04.402128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:04.402627 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:04.407522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:04.407980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:04.409066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:04.409697 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:04.675400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:04.692021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:04.695001 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:04.700130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b334804a-ac90-495c-8512-dceaf0769468 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.325077 Sep 01 09:14:04.704587 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 198/404] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:04 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:04.725386 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:04.728400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:04.729166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:04.732040 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:04.733414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:04.734245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:04.951280 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:04.962966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:04.965863 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:04.967682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-be7aa1e7-28d9-49fe-8061-89111c367cc0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.285536 Sep 01 09:14:04.970396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 207/405] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:04 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:05.172062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-c0d311ba-e0ea-4325-8934-5513e018ba86 req-7be38c17-314f-486c-bc05-103911614a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac83a3c-c919-4dbb-a392-fd9459442d2a", "name": "network-vif-plugged", "status": "completed", "tag": "98574c41-a06d-4fbc-920f-cf631757e699"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:05.193181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:05.196029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-c0d311ba-e0ea-4325-8934-5513e018ba86 req-7be38c17-314f-486c-bc05-103911614a02 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:05.197112 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:05.197905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-c0d311ba-e0ea-4325-8934-5513e018ba86 req-7be38c17-314f-486c-bc05-103911614a02 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:05.198708 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-c0d311ba-e0ea-4325-8934-5513e018ba86 req-7be38c17-314f-486c-bc05-103911614a02 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:05.207626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:05.217211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:05.223467 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:05.223467 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:05.223883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-c0d311ba-e0ea-4325-8934-5513e018ba86 req-7be38c17-314f-486c-bc05-103911614a02 service nova] Creating event network-vif-plugged:98574c41-a06d-4fbc-920f-cf631757e699 for instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a on hv-cinder-82002 Sep 01 09:14:05.224486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:05.226251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:05.228130 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:05.229659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-c0d311ba-e0ea-4325-8934-5513e018ba86 req-7be38c17-314f-486c-bc05-103911614a02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061268 Sep 01 09:14:05.230900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 199/406] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:05.435677 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:05.444784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-041b70cb-f9f9-44d2-8f3c-947e29e028ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.262125 Sep 01 09:14:05.449716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 208/407] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:05 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:05.730715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:05.731804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:05.738862 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:05.739611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:05.739890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:05.740698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:05.741178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:05.741597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:05.836894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-ad1b992b-43ab-417a-8ba1-07d6a222fcc4 req-b118edb4-767e-43f1-959f-74964ae0e80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16aac3dd-aaba-4552-80bd-3673dc9ffbe5", "tag": "ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:05.850257 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-ad1b992b-43ab-417a-8ba1-07d6a222fcc4 req-b118edb4-767e-43f1-959f-74964ae0e80b service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:05.851389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-ad1b992b-43ab-417a-8ba1-07d6a222fcc4 req-b118edb4-767e-43f1-959f-74964ae0e80b service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:05.853258 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-ad1b992b-43ab-417a-8ba1-07d6a222fcc4 req-b118edb4-767e-43f1-959f-74964ae0e80b service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:05.882675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-ad1b992b-43ab-417a-8ba1-07d6a222fcc4 req-b118edb4-767e-43f1-959f-74964ae0e80b service nova] Creating event network-changed:ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2 for instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 on hv-cinder-82002 Sep 01 09:14:05.891265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-ad1b992b-43ab-417a-8ba1-07d6a222fcc4 req-b118edb4-767e-43f1-959f-74964ae0e80b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060983 Sep 01 09:14:05.892764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 209/408] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:05.964188 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:05.976402 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-adb3df89-102b-4b6e-91a8-6166919252a4 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.250762 Sep 01 09:14:05.996432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:05.997142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:05.999246 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=4 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:06.000795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 200/409] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:05 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:06.005045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:06.005698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:06.006291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:06.011323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:06.011323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:06.011323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:06.164971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=18 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:06.186208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:06.195398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:06.196842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:06.198048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6cf14e9a-2314-4124-b696-2074bd24b557 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.206053 Sep 01 09:14:06.198624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 210/410] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:05 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:06.469657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:06.470261 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:06.476538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:06.477000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:06.477432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:06.478121 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:06.478568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:06.478990 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:06.611086 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:06.619570 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-70f7b16f-ed95-48f8-a1b9-ea8f6a8bfa41 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.153660 Sep 01 09:14:06.620445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 201/411] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:06 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:06.999595 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:07.000573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:07.008981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:07.009559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:07.010243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:07.011212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:07.011870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:07.012393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:07.161336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:07.170099 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b4ffaa87-c790-4cfa-82f0-f9ea526efeb8 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1315 microversion: 2.1 time: 0.176183 Sep 01 09:14:07.170981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 211/412] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:06 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:07.223007 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:07.224635 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:07.231403 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:07.231972 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:07.232620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:07.233319 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:07.233771 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:07.234190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:07.405201 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:07.415658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:07.417708 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:07.419240 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-41d3c761-3b00-499a-837a-f46b42b8ab60 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.201016 Sep 01 09:14:07.420195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 202/413] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:07 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:07.641450 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:07.642381 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:07.649642 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:07.650492 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:07.651238 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:07.652346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:07.653020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:07.653661 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:07.810398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:07.819999 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-52e520eb-736f-41be-ad47-3bd3d33e6700 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.182626 Sep 01 09:14:07.823487 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 212/414] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:07 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:08.193254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:08.193871 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:08.200310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.200803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.201238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.202130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.202729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.203404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.344859 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:08.352956 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e8b30677-a2b6-4a8c-9a40-23498a7acc75 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1465 microversion: 2.1 time: 0.164224 Sep 01 09:14:08.353525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 203/415] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:08 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1465 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:08.407475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:08.408068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:08.415587 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.416223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.419212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.420002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.420495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.420921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.449981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:08.450829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:08.452851 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:14:08.461339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.462029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.462670 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.463603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.464200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.464845 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.683790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:08.694970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:08.695584 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:08.696776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6c9c6af3-2756-4f0a-bc78-4f5ecc27cd25 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.253706 Sep 01 09:14:08.697343 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 204/416] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:08 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:14:08.787265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-841b13b5-c8fa-4c25-82e5-a8fb788e6ab2 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 204 len: 0 microversion: 2.1 time: 0.383848 Sep 01 09:14:08.788514 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 213/417] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:14:08 2022] DELETE /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:14:08.796792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:08.798174 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:08.805578 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.809953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.809953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.809953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.809953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.810324 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.842939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:08.844349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:08.853735 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.854513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.856598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:08.857480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:08.859658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:08.860096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:09.013760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:09.023888 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-641aac35-561f-4360-b78f-b2072744f005 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1471 microversion: 2.1 time: 0.231097 Sep 01 09:14:09.024768 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 205/418] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:08 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:09.051205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:09.060241 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4ed7e05c-7fe5-45cf-b899-3c8cb4d60f3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.221894 Sep 01 09:14:09.061259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 214/419] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:08 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:09.724313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:09.724931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:09.731448 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:09.731981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:09.732418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:09.733106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:09.733563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:09.733987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:09.886283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:09.896479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:09.897985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:09.899670 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-34ef56cd-2548-4b97-a69c-cd9fca86f6d1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.180340 Sep 01 09:14:09.901690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 206/420] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:09 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:10.046457 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:10.048098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:10.069917 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:10.070693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:10.071331 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:10.072022 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:10.072625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:10.073202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:10.081561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:10.082780 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:10.091765 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:10.093504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:10.093504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:10.093787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:10.094327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:10.094821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:10.262859 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:10.273699 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-02b5446f-658c-45ad-87a9-6112f54f47fd tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1471 microversion: 2.1 time: 0.230459 Sep 01 09:14:10.283843 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 215/421] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:10 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:10.310364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:10.322418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0ef92258-f54b-4fa7-b052-ccbc95b6e93b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.242821 Sep 01 09:14:10.328178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 207/422] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:10 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:10.927358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:10.928664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:10.935241 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:10.935867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:10.936570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:10.937559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:10.938098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:10.938594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:11.087383 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:11.097884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:11.099626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:11.100982 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bd0a4cdb-0345-496c-bbe3-3437c32fa25e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.180688 Sep 01 09:14:11.101539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 216/423] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:10 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:11.300465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:11.300937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:11.303695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:11.311197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:11.311893 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:11.312424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:11.313393 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:11.314074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:11.314600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:11.344995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:11.345605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:11.352191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:11.357658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:11.358318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:11.359238 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:11.359841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:11.360479 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:11.501178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:11.513224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d532f9c7-d339-42dd-a033-fe3a82cb11ce tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1471 microversion: 2.1 time: 0.221702 Sep 01 09:14:11.527539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 208/424] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:11 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:11.564334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:11.574019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f3f42c99-c6ab-4fca-8e37-ca1a01b20092 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.233801 Sep 01 09:14:11.588734 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 217/425] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:11 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:12.125445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:12.126467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:12.136978 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:12.137576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:12.138088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:12.138882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:12.139465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:12.140038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:12.295908 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:12.307855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:12.310013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:12.311404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-60c8ed26-ad2c-4fd0-b45c-3825c53fb27a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.189951 Sep 01 09:14:12.312122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 209/426] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:12 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:12.548286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:12.550058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:12.581739 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:12.582236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:12.582671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:12.583497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:12.583924 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:12.584347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:12.599512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:12.606469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:12.632787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:12.632988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:12.642153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:12.646615 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:12.647508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:12.647996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:12.648436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:12.707777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:12.717479 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cd40dfb5-5ab9-49a4-a505-e2521cd5cd43 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1429 microversion: 2.1 time: 0.173341 Sep 01 09:14:12.718307 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 218/427] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:12 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1429 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:12.723341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-13972310-bea7-4839-bf9f-7f6ce3e79934 req-6b6a64cc-e1e8-4518-8e97-cf579b247c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac83a3c-c919-4dbb-a392-fd9459442d2a", "name": "network-vif-deleted", "tag": "98574c41-a06d-4fbc-920f-cf631757e699"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:12.733747 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-13972310-bea7-4839-bf9f-7f6ce3e79934 req-6b6a64cc-e1e8-4518-8e97-cf579b247c8a service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:12.734228 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-13972310-bea7-4839-bf9f-7f6ce3e79934 req-6b6a64cc-e1e8-4518-8e97-cf579b247c8a service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:12.734666 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-13972310-bea7-4839-bf9f-7f6ce3e79934 req-6b6a64cc-e1e8-4518-8e97-cf579b247c8a service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:12.748808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-13972310-bea7-4839-bf9f-7f6ce3e79934 req-6b6a64cc-e1e8-4518-8e97-cf579b247c8a service nova] Creating event network-vif-deleted:98574c41-a06d-4fbc-920f-cf631757e699 for instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a on hv-cinder-82002 Sep 01 09:14:12.754910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-13972310-bea7-4839-bf9f-7f6ce3e79934 req-6b6a64cc-e1e8-4518-8e97-cf579b247c8a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035675 Sep 01 09:14:12.755753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 219/428] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:12.840746 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:12.849679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7401c0ce-9ee4-41e7-8c1d-9f00b9fff6aa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.256575 Sep 01 09:14:12.854726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 210/429] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:12 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:13.337960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:13.338730 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:13.347513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:13.348158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:13.348757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:13.349601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:13.350105 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:13.350636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:13.534913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:13.545559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:13.547420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:13.550498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-97ab5abf-d147-4a3a-86ee-3e087828af37 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.217547 Sep 01 09:14:13.552468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 220/430] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:13 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:13.742681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:13.743982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:13.750511 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:13.750988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:13.751457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:13.752325 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:13.753262 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:13.753679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:13.823446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:13.832885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-07b90312-d55f-4255-9310-a192f63d6668 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1429 microversion: 2.1 time: 0.094319 Sep 01 09:14:13.839732 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 211/431] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:13 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:13.871010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:13.871700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:13.879160 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:13.879653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:13.880085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:13.880772 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:13.881224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:13.881645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:14.024664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:14.032870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-46004484-6113-4609-8284-7f24fb23757f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.165897 Sep 01 09:14:14.034836 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 221/432] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:13 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:14.575235 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:14.575946 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:14.586968 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:14.588047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:14.588644 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:14.589507 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:14.589967 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:14.590404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:14.738847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:14.750169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:14.751874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:14.753765 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7b81fd70-2d66-4059-b114-458c0b550878 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.183004 Sep 01 09:14:14.754349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 212/433] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:14 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:14.853990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:14.854788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:14.863439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:14.864288 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:14.864929 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:14.865861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:14.866388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:14.866819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:14.938238 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:14.947011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-58739ec7-4b02-47ef-81c5-ba01be1ed23b tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1429 microversion: 2.1 time: 0.096922 Sep 01 09:14:14.947838 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 222/434] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:14 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:15.060772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:15.061577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:15.075564 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:15.076196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:15.076763 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:15.077586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:15.078080 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:15.078516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:15.265369 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:15.275132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0636c6f8-64ee-4ac1-a473-68ff326481ac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.223410 Sep 01 09:14:15.276055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 213/435] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:15 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:15.777158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:15.777941 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:15.783900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:15.784388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:15.784836 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:15.785497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:15.785945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:15.786367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:15.961522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:15.968828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:15.970165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:15.972737 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:15.974925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:15.976458 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2057f908-c986-4b87-8384-0a24b077ab47 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1744 microversion: 2.20 time: 0.203371 Sep 01 09:14:15.977192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 223/436] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:15 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:15.978172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:15.978811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:15.979440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:15.982677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:15.982677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:15.982677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:16.053522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:16.054134 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:16.055084 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:16.055807 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lazy-loading 'fault' on Instance uuid 7ac83a3c-c919-4dbb-a392-fd9459442d2a {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:14:16.119664 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3c9be876d64ece967dc67974d600fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4299d4d3bdaf4d97908a7e404f99d815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:16.131341 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fcc3d18c-d19a-4b3b-b67f-bb9d36195a64 tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 200 len: 1305 microversion: 2.1 time: 0.166250 Sep 01 09:14:16.147145 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 214/437] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:15 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:16.297017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:16.298420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:16.310185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:16.310185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:16.314293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:16.315020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:16.316210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:16.316811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:16.462453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:16.470565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-53aca37a-d086-41d0-b547-be8e22c11049 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.178045 Sep 01 09:14:16.475143 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 224/438] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:16 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:16.790646 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6eb9d01f-a97d-41b3-a89b-3ebd9b8ac341 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:16.796916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6eb9d01f-a97d-41b3-a89b-3ebd9b8ac341 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:16.797405 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6eb9d01f-a97d-41b3-a89b-3ebd9b8ac341 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:16.797855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6eb9d01f-a97d-41b3-a89b-3ebd9b8ac341 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:16.861309 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6eb9d01f-a97d-41b3-a89b-3ebd9b8ac341 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Going to try to stop instance {{(pid=121063) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 09:14:16.879412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:17.000930 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:17.001894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:17.007870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.008420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.008863 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.009550 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.010006 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.010432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.063660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6eb9d01f-a97d-41b3-a89b-3ebd9b8ac341 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action" status: 202 len: 0 microversion: 2.1 time: 0.276617 Sep 01 09:14:17.064399 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 215/439] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:14:16 2022] POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:14:17.072959 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:17.073750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:17.080013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.080502 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.081761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.082485 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.082949 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.083405 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.143408 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:17.152815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:17.154340 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:17.155638 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-59ff6974-fcab-4446-9c4e-2109c53e6b9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1744 microversion: 2.20 time: 0.158669 Sep 01 09:14:17.156208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 225/440] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:16 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:14:17.161257 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:17.161866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] [instance: 7ac83a3c-c919-4dbb-a392-fd9459442d2a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:17.168908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.169341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.169788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.170486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.170942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.171565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.188367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] HTTP exception thrown: Instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a could not be found. Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Request method failure captured: Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a HTTP/1.1 Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHfLzICdySlUqzSSCKynCP9fUaeMyssDrfMeQgrJBfZ3dFvGSyTx3xfdCCWRhw6EvsNdKcmqyw3VDmpbPJ63CprfSdf3iariD3yJI9NJUr22yXugqbPOVtL5XpFtyancUqMgyzfFe9ECI4d_a83hC7--7b2a77kyP0IVoBILKcRsLS8 Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 4299d4d3bdaf4d97908a7e404f99d815 Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesNegativeTest-981874859 Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:14:17.190007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4299d4d3bdaf4d97908a7e404f99d815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4299d4d3bdaf4d97908a7e404f99d815", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4299d4d3bdaf4d97908a7e404f99d815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4299d4d3bdaf4d97908a7e404f99d815"}]}] Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesNegativeTest-981874859 Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 4299d4d3bdaf4d97908a7e404f99d815 Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesNegativeTest-981874859 Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesNegativeTest-981874859-project Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 0f3c9be876d64ece967dc67974d600fa Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesNegativeTest-981874859-project Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a could not be found. Sep 01 09:14:17.191801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '7ac83a3c-c919-4dbb-a392-fd9459442d2a'} Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a could not be found. Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:14:17.192764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a could not be found. Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a could not be found. Sep 01 09:14:17.194259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:14:17.195593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] Returning 404 to user: Instance 7ac83a3c-c919-4dbb-a392-fd9459442d2a could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:14:17.195593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64e0b62f-42d8-4316-8665-85f86678d5bf tempest-VolumesNegativeTest-981874859 tempest-VolumesNegativeTest-981874859-project] 10.222.0.46 "GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a" status: 404 len: 111 microversion: 2.1 time: 0.034528 Sep 01 09:14:17.195593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 226/441] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:17 2022] GET /compute/v2.1/servers/7ac83a3c-c919-4dbb-a392-fd9459442d2a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:14:17.224715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:17.233524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a8684a31-a361-48d3-8d92-80cb7fef969e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.164750 Sep 01 09:14:17.234090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 216/442] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:17 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:17.492167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:17.492808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:17.498747 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.499289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.499717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.500397 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:17.501483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:17.501916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:17.641287 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:17.650649 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0122c51d-3d05-4fc2-9bdb-d551b8eced2e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.162342 Sep 01 09:14:17.651234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 227/443] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:17 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:18.178134 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:18.178779 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:18.185805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:18.189443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:18.189443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:18.189443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:18.189443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:18.189918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:18.254172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:18.254790 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:18.260882 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:18.261385 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:18.261814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:18.262710 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:18.263193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:18.263618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:18.345307 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:18.354020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:18.355492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:18.356694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-995a72ab-32d8-48c2-ba91-764c0370cf15 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1744 microversion: 2.20 time: 0.182596 Sep 01 09:14:18.367279 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 217/444] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:18 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:18.413398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:18.422042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e8316349-7613-406d-a959-e3f8ca0b45ae tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.172129 Sep 01 09:14:18.422622 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 228/445] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:18 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:18.513638 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-61de6161-0d23-4b12-a881-d3df9f32b9de req-f9abf25e-8e46-41a2-93ea-a32a602b63e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfa76cf-89f5-4112-a5ae-859e051bbe0d", "name": "network-vif-plugged", "status": "completed", "tag": "8bfe0a67-ded1-411e-bbbd-beb319ed33d0"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:18.529673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-61de6161-0d23-4b12-a881-d3df9f32b9de req-f9abf25e-8e46-41a2-93ea-a32a602b63e4 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:18.529673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-61de6161-0d23-4b12-a881-d3df9f32b9de req-f9abf25e-8e46-41a2-93ea-a32a602b63e4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:18.529673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-61de6161-0d23-4b12-a881-d3df9f32b9de req-f9abf25e-8e46-41a2-93ea-a32a602b63e4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:18.537582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-61de6161-0d23-4b12-a881-d3df9f32b9de req-f9abf25e-8e46-41a2-93ea-a32a602b63e4 service nova] Creating event network-vif-plugged:8bfe0a67-ded1-411e-bbbd-beb319ed33d0 for instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d on hv-cinder-82002 Sep 01 09:14:18.542371 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-61de6161-0d23-4b12-a881-d3df9f32b9de req-f9abf25e-8e46-41a2-93ea-a32a602b63e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032621 Sep 01 09:14:18.542962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 218/446] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:14:18.672039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:18.672648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:18.680302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:18.681056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:18.681417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:18.683256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:18.683720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:18.684142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:18.831289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:18.839080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d2474754-fed7-4963-a20e-99af52179185 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.171128 Sep 01 09:14:18.839679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 229/447] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:18 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:19.381829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:19.382531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:19.388910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:19.389473 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:19.393656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:19.398809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:19.400220 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:19.401550 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:19.444487 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:19.445114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:19.451827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:19.452313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:19.452756 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:19.453455 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:19.453905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:19.454325 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:19.575831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:19.584974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:19.586683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:19.588764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9f535d58-85c1-4d40-bc0e-792e2d77ca2a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1744 microversion: 2.20 time: 0.212692 Sep 01 09:14:19.591807 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 219/448] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:19 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:19.795774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:19.806398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dbc9e7e1-bfff-406c-bbb8-80fda651ed3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.366382 Sep 01 09:14:19.810042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 230/449] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:19 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:19.860455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:19.861978 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:19.869234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:19.869722 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:19.872574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:19.872574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:19.872574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:19.872574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:20.029305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:20.038083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ee89a6d1-cbfa-497a-8b31-e583806a4cac tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.181768 Sep 01 09:14:20.038774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 220/450] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:19 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:20.568261 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-238472cc-4e62-4688-b27b-e3a93b6af1d5 req-60916839-ad5f-4293-82a2-cf4151834782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16aac3dd-aaba-4552-80bd-3673dc9ffbe5", "name": "network-vif-plugged", "status": "completed", "tag": "ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:20.591783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-238472cc-4e62-4688-b27b-e3a93b6af1d5 req-60916839-ad5f-4293-82a2-cf4151834782 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:20.592663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-238472cc-4e62-4688-b27b-e3a93b6af1d5 req-60916839-ad5f-4293-82a2-cf4151834782 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:20.593392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-238472cc-4e62-4688-b27b-e3a93b6af1d5 req-60916839-ad5f-4293-82a2-cf4151834782 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:20.611460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-238472cc-4e62-4688-b27b-e3a93b6af1d5 req-60916839-ad5f-4293-82a2-cf4151834782 service nova] Creating event network-vif-plugged:ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2 for instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 on hv-cinder-82002 Sep 01 09:14:20.616403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-238472cc-4e62-4688-b27b-e3a93b6af1d5 req-60916839-ad5f-4293-82a2-cf4151834782 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060613 Sep 01 09:14:20.617111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:20.617850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:20.618199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 231/451] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:20.631593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:20.631899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:20.632361 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:20.633249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:20.633719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:20.634153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:20.791044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:20.799490 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:20.800942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:20.802091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d2013430-3a1a-4a43-9663-24575f1f50b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1744 microversion: 2.20 time: 0.190071 Sep 01 09:14:20.802673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 221/452] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:20 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:20.828165 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:20.828864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:20.836317 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:20.836817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:20.837423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:20.838114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:20.838566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:20.838985 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:21.039884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:21.050379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7a240ef6-e51b-4678-a67e-d90edd5b448f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.226295 Sep 01 09:14:21.051224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 232/453] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:20 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:21.068026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:21.069171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:21.077071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:21.077941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:21.078707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:21.080565 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:21.081341 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:21.081984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:21.313711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:21.325173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9d4e9b67-90b8-4653-996b-64597a496760 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.266947 Sep 01 09:14:21.335131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 222/454] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:21 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:21.825805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:21.826418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:21.832603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:21.833090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:21.833585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:21.834276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:21.834731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:21.835188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:21.966344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:21.974742 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:21.976418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:21.977630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e47f20ce-03c3-4aa7-9080-758c2603e0fa tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1744 microversion: 2.20 time: 0.156033 Sep 01 09:14:21.978191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 233/455] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:21 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:22.073204 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:22.074059 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:22.080686 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:22.081162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:22.081596 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:22.082277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:22.082734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:22.083181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:22.229543 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:22.237779 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-36a8c690-7542-49bf-bfb1-68779c197673 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.168452 Sep 01 09:14:22.238357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 223/456] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:22 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:22.347274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:22.347966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:22.356209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:22.356563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:22.357013 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:22.357805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:22.358262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:22.358691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:22.490682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:22.498495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-80b098f5-6276-4cef-b8bd-4dcd0fe8226e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1365 microversion: 2.1 time: 0.155198 Sep 01 09:14:22.512333 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 234/457] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:22 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:23.002212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:23.002824 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:23.009402 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.009881 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.010403 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.011306 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.011757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.012191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.147039 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:23.155447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:23.157056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:23.158381 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1888335b-b35e-4c1e-b427-f6d768b5634e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1744 microversion: 2.20 time: 0.161325 Sep 01 09:14:23.158954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 224/458] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:22 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:23.269518 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:23.270822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:23.277594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.278080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.278511 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.279582 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.280285 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.280674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.479920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:23.488923 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ec23b389-fe61-40ec-8018-d61594684f0d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.230965 Sep 01 09:14:23.489519 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 235/459] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:23 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:23.520424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:23.520724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:23.527001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.527541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.527951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.528629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.529078 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.529492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.668114 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:23.677599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-95f7d8ef-8952-4448-b26c-6a849ecc9643 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1554 microversion: 2.1 time: 0.161601 Sep 01 09:14:23.678212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 225/460] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:23 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:23.699060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:23.699633 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:23.706092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.706593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.707223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.708137 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:23.708597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:23.709233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:23.851236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-090314bf-6c2e-47c5-818d-57e08e016683 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156171 Sep 01 09:14:23.859146 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 236/461] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:14:23 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:24.184449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:24.185139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:24.193256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:24.194383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:24.194919 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:24.195898 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:24.196516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:24.197128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:24.350161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:24.359297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:24.361273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:24.362656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-44c8ce02-d50f-4710-acb2-974e6114f6b0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.184456 Sep 01 09:14:24.363236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 226/462] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:24 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:24.509914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:24.510614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:24.520048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:24.520636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:24.521285 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:24.521984 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:24.522442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:24.522871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:24.525756 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:24.737900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:24.749102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2f18fc41-8fbb-4d16-8d8b-4980bc029c15 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.243015 Sep 01 09:14:24.753843 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 237/463] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:24 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:25.214294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-763c1d09-fc99-4cd8-859b-701ae4237054 req-f18ad290-4068-46d8-916f-4cd15bd8e547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16aac3dd-aaba-4552-80bd-3673dc9ffbe5", "tag": "ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:25.241932 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-763c1d09-fc99-4cd8-859b-701ae4237054 req-f18ad290-4068-46d8-916f-4cd15bd8e547 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:25.242771 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-763c1d09-fc99-4cd8-859b-701ae4237054 req-f18ad290-4068-46d8-916f-4cd15bd8e547 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:25.243418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-763c1d09-fc99-4cd8-859b-701ae4237054 req-f18ad290-4068-46d8-916f-4cd15bd8e547 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:25.257110 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-763c1d09-fc99-4cd8-859b-701ae4237054 req-f18ad290-4068-46d8-916f-4cd15bd8e547 service nova] Creating event network-changed:ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2 for instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 on hv-cinder-82002 Sep 01 09:14:25.262925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-763c1d09-fc99-4cd8-859b-701ae4237054 req-f18ad290-4068-46d8-916f-4cd15bd8e547 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053734 Sep 01 09:14:25.264023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 227/464] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:25.397688 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:25.398324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:25.414806 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:25.416556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:25.419644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:25.422715 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:25.426065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:25.426554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:25.775125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:25.776120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:25.795659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:25.797043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:25.797542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:25.798260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:25.798799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:25.799495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:25.876753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:25.886559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:25.898690 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:25.904038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cd2ced14-e172-4f8c-8cab-0d0cd1ac165b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.521241 Sep 01 09:14:25.908052 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 238/465] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:25 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:26.257858 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:26.270811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-559e781c-6f2d-4eeb-b8a1-a72847b772b0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.499871 Sep 01 09:14:26.287361 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 228/466] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:25 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:26.936190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:26.937758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:26.939946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:26.948855 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:26.956209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:26.956209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:26.956209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:26.956209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:26.956820 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:27.300579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:27.301828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:27.311504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:27.316377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:27.317050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:27.317946 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:27.319555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:27.320189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:27.587224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:27.603462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:27.606460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:27.611217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-43c4a274-cedf-4325-af7c-6ed34f58c8ce tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.678853 Sep 01 09:14:27.613749 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 239/467] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:26 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:27.800985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:27.814239 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c49f2fc5-228c-4330-b2f9-63abad9290ce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.523562 Sep 01 09:14:27.814891 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 229/468] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:27 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:28.643874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:28.644512 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:28.653164 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:28.654032 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:28.655523 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:28.656735 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:28.657433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:28.658244 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:28.918436 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:28.919537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:28.919537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:28.920135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:28.920240 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:28.920240 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:28.920403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:28.920510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:28.920510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:28.920510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:28.920747 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c5fe7730-0504-4d82-a7dc-a0c81a4ed733 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.212655 Sep 01 09:14:28.920840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:28.920928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 240/469] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:28 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:29.088757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:29.089103 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-46de3cf8-29e7-4fa0-9656-1c5689ee6b3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.256959 Sep 01 09:14:29.089947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 230/470] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:28 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:29.917963 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:29.919232 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:29.934178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:29.938415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:29.938888 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:29.939925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:29.944680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:29.945427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:30.111246 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:30.111887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:30.127352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:30.128164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:30.131214 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:30.134590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:30.136097 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:30.137695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:30.159618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:30.178727 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:30.191407 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:30.193913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-26d8f36e-48cb-4519-a99a-bc1f24fe32bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.280030 Sep 01 09:14:30.199651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 241/471] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:29 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:30.392238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:30.402822 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-33962f1c-ef02-467a-90c2-dfe8a7c401e1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.296335 Sep 01 09:14:30.406775 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 231/472] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:30 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:31.226756 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:31.229048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:31.241396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:31.242170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:31.242774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:31.243679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:31.244468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:31.245050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:31.428555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:31.430009 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:31.441108 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:31.446736 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:31.447424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:31.452672 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:31.452672 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:31.452915 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:31.453038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:31.464696 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:31.466978 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:31.468533 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-282eccdc-78f9-44f1-8316-06f30e703ff0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.248114 Sep 01 09:14:31.470926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 242/473] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:31 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:31.634001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:31.648071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cdd2b35b-f171-466b-bd19-a1b5474a0fda tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.223362 Sep 01 09:14:31.649110 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 232/474] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:31 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:32.493747 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:32.494451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:32.501549 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:32.502544 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:32.503742 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:32.504622 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:32.505228 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:32.505943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:32.675151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:32.676437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:32.692745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:32.695299 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:32.695944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:32.696836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:32.697446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:32.698047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:32.719864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:32.757292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:32.768607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:32.770585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:32.771946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0e95d182-0548-4b3d-ac0f-45ddf22b5084 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.282031 Sep 01 09:14:32.772606 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 243/475] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:32 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:32.881532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:32.894092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fa7bdc97-efe4-45e1-af23-5a36a960a347 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1721 microversion: 2.1 time: 0.222894 Sep 01 09:14:32.907773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 233/476] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:32 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:33.798804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:33.799496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:33.814230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:33.814733 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:33.815316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:33.816555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:33.817216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:33.819789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:33.927064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:33.928413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:33.946840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:33.952026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:33.952636 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:33.954189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:33.956346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:33.956886 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:34.036371 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:34.051262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:34.055047 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:34.060315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2a45f7a6-9c89-4817-b078-1ca303e02037 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.264598 Sep 01 09:14:34.061190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 244/477] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:33 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:34.240529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:34.252404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-672dc18e-f3e4-4340-aa93-979e48d3dddb tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1698 microversion: 2.1 time: 0.333610 Sep 01 09:14:34.253230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 234/478] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:33 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1698 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:34.281854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64eff924-a9ed-457e-ab9a-e4d29dd09e01 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:34.294320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64eff924-a9ed-457e-ab9a-e4d29dd09e01 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:34.294809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64eff924-a9ed-457e-ab9a-e4d29dd09e01 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:34.295270 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64eff924-a9ed-457e-ab9a-e4d29dd09e01 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:34.436550 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64eff924-a9ed-457e-ab9a-e4d29dd09e01 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Going to try to start instance {{(pid=121062) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 09:14:34.744262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64eff924-a9ed-457e-ab9a-e4d29dd09e01 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action" status: 202 len: 0 microversion: 2.1 time: 0.466624 Sep 01 09:14:34.744881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 245/479] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:14:34 2022] POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:14:34.753750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:34.754621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:34.771137 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:34.771137 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:34.771137 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:34.771137 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:34.771681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:34.772312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:35.090348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:35.091879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:35.115710 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:35.116262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:35.116634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:35.125659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:35.127615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:35.128227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:35.557336 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:35.571671 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b657838d-35b4-4bc3-82b7-2d7ce6049636 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1707 microversion: 2.1 time: 0.822244 Sep 01 09:14:35.590248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 235/480] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:34 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1707 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:36.006905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:36.018822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:36.020323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:36.021502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e2ed5dd1-d98e-4bb6-bcfe-81ad57b04e36 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.937984 Sep 01 09:14:36.033528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 246/481] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:35 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:36.599616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:36.600241 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:36.609464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:36.609968 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:36.610413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:36.611142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:36.611605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:36.612033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:36.944769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:36.955529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-00efea37-6d5e-4254-8395-22a2b0ef4b07 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1707 microversion: 2.1 time: 0.361442 Sep 01 09:14:36.956762 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 236/482] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:36 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1707 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:37.049394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:37.050640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:37.067208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:37.069127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:37.069127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:37.069127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:37.069841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:37.070418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:37.352460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:37.363971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:37.365932 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:37.367336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d8a94dfd-5e4e-4cd5-b768-5aff705d2ac7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.321772 Sep 01 09:14:37.368442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 247/483] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:37 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:37.987719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:37.987719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:37.992935 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:37.993661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:37.997005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:37.998154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:37.998491 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:37.998927 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:38.245809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:38.256545 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dc42126b-e453-4492-a43e-521f06ae389e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1711 microversion: 2.1 time: 0.282887 Sep 01 09:14:38.257356 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 237/484] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:37 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1711 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:38.396201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:38.396912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:38.404287 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:38.404855 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:38.405542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:38.406371 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:38.406920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:38.407383 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:38.546082 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:38.555716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:38.556494 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:38.558185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b1df5748-709d-4c6b-85bf-629fc219dff1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.167302 Sep 01 09:14:38.558848 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 248/485] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:38 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:39.593163 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:39.594544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:39.603013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:39.603906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:39.604643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:39.605401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:39.605890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:39.606322 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:40.074803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:40.091536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:40.093255 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:40.094816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1bdaddae-aad6-4c4e-9df5-e5a5aaafb596 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1739 microversion: 2.20 time: 0.507467 Sep 01 09:14:40.108238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 238/486] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:39 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1739 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:41.122739 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:41.123508 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:41.129809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:41.130313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:41.130927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:41.131655 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:41.132266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:41.132845 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:41.390715 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:41.400657 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:41.402341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:41.403849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3f72de46-fd95-4c58-9347-34252efdf393 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1721 microversion: 2.20 time: 0.287840 Sep 01 09:14:41.406625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 249/487] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:41 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:42.433312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:42.434921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:42.438526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=64 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:42.442661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:42.443418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:42.444219 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:42.444858 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:42.445316 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:42.446042 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:42.609979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:42.622543 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:42.624112 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:42.625366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a4a31bed-19c8-4f4a-954a-bc57bf12cbb3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1721 microversion: 2.20 time: 0.197382 Sep 01 09:14:42.639437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 239/488] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:42 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:43.650468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:43.651260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:43.657382 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:43.657872 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:43.658546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:43.659141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:43.659686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:43.660352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:43.823306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:43.831741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:43.833300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:43.834446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6d8ab33d-3c83-491f-a680-b7ac350f0d55 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1721 microversion: 2.20 time: 0.188916 Sep 01 09:14:43.835011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 250/489] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:43 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:44.356685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-4fdb3d15-2bd4-46c7-9da7-466df970b41f req-ccb90d9e-8412-4702-9f4f-aadacc44e78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfa76cf-89f5-4112-a5ae-859e051bbe0d", "name": "network-vif-unplugged", "status": "completed", "tag": "8bfe0a67-ded1-411e-bbbd-beb319ed33d0"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:44.367273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-4fdb3d15-2bd4-46c7-9da7-466df970b41f req-ccb90d9e-8412-4702-9f4f-aadacc44e78e service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:44.367795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-4fdb3d15-2bd4-46c7-9da7-466df970b41f req-ccb90d9e-8412-4702-9f4f-aadacc44e78e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:44.368856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-4fdb3d15-2bd4-46c7-9da7-466df970b41f req-ccb90d9e-8412-4702-9f4f-aadacc44e78e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:44.380172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-4fdb3d15-2bd4-46c7-9da7-466df970b41f req-ccb90d9e-8412-4702-9f4f-aadacc44e78e service nova] Creating event network-vif-unplugged:8bfe0a67-ded1-411e-bbbd-beb319ed33d0 for instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d on hv-cinder-82002 Sep 01 09:14:44.385404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-4fdb3d15-2bd4-46c7-9da7-466df970b41f req-ccb90d9e-8412-4702-9f4f-aadacc44e78e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033796 Sep 01 09:14:44.386011 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 240/490] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:44.858773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:44.866861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:44.876343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:44.879742 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:44.880418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:44.882177 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:44.884952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:44.885566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:45.083396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:45.097876 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:45.099342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:45.100504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-905d16ea-bb41-4f3f-b6a6-a0d8a7411ef6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1724 microversion: 2.20 time: 0.246156 Sep 01 09:14:45.115452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 251/491] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:44 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:45.126402 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e46cc0eb-a5e8-4af9-b32f-c4f246b2c63d"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:45.130653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:45.137191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:45.137830 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:45.138376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:45.139457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:45.140014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:45.141121 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:46.227096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9a8fb568-001d-488c-87f6-17ef8899acbc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.104860 Sep 01 09:14:46.236219 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 241/492] 10.222.0.46 () {62 vars in 1364 bytes} [Thu Sep 1 09:14:45 2022] POST /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments => generated 188 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:14:46.369798 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:46.370396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:46.376788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:46.377582 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:46.378232 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:46.379159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:46.379807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:46.380549 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:46.428183 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121062) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 09:14:46.527783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:46.689227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f6585e80-84dc-4beb-a33e-fae0b80bc6d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/action" status: 202 len: 0 microversion: 2.20 time: 0.323791 Sep 01 09:14:46.689852 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 252/493] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Sep 1 09:14:46 2022] POST /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:14:46.699451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:46.700300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:46.707020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:46.708196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:46.708196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:46.709293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:46.709848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:46.710567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:46.949987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:46.959247 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:46.963181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:46.964582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fc666b3d-5822-40fb-90e3-ab930322c091 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1750 microversion: 2.20 time: 0.270344 Sep 01 09:14:46.965868 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 242/494] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:46 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:47.996831 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:47.997462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:48.006431 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:48.006926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:48.009854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:48.010636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:48.011150 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:48.011580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:48.177663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:48.195638 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:48.197222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:48.198616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-42cab4f6-55cc-40e2-9935-ca5b33426fbf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1750 microversion: 2.20 time: 0.210503 Sep 01 09:14:48.199319 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 253/495] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:47 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1750 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:14:49.222658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:49.224076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:49.231527 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:49.232004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:49.232608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:49.233300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:49.233903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:49.234662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:49.396674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:49.408674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:49.423244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:49.423244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-67b53e80-5a92-4bbe-8f5b-79125fbcb816 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1752 microversion: 2.20 time: 0.193327 Sep 01 09:14:49.423900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 243/496] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:49 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:50.436501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:50.437273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:50.444990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:50.445565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:50.446041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:50.446768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:50.447534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:50.447965 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:50.590861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:50.599605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:50.601397 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:50.602548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b09419d8-750b-40c2-8bb6-043ecaa10359 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.170470 Sep 01 09:14:50.603131 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 254/497] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:50 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:51.625879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:51.627420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:51.633599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:51.634086 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:51.634522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:51.635244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:51.635703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:51.636136 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:51.766809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:51.777049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:51.781525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:51.784200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3d2027be-3f5d-4c84-bc4c-610f48e2e8f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.161345 Sep 01 09:14:51.784783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 244/498] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:51 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:51.971614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fc50b156-24b3-4df7-be8c-125c509d3f2e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Action: 'create', calling method: .version_select at 0x7f7a656511f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1365158653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIONLh+EtSMZgaH8gLEATEADnA4q7xe7ubamnG3oRWJGmjnWxqaE28lxaVU7KvFf2bhFhdU1NWkdpC9Ke6gS2K5UlnOJtdn/RX2TFKlZL6UIigMGoqCGQQC2X+yJlQEWDw=="}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:51.987523 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-fc50b156-24b3-4df7-be8c-125c509d3f2e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Getting quotas for project 14201dd9cdf946d2824c31e55c0573f8. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:14:51.991418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-fc50b156-24b3-4df7-be8c-125c509d3f2e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Getting quotas for user e64f94da55234c21889ecf1cd2220ed5 and project 14201dd9cdf946d2824c31e55c0573f8. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:14:52.077728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fc50b156-24b3-4df7-be8c-125c509d3f2e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.110044 Sep 01 09:14:52.078600 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 255/499] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:14:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:14:52.134635 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-962044314", "imageRef": "67862398-ccf8-4489-ba45-8fa6201ae830", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1365158653", "networks": [{"uuid": "26ba74ff-1d81-45bf-ad5d-44647111abd0"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:14:52.208885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] validate_networks() for [('26ba74ff-1d81-45bf-ad5d-44647111abd0', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:14:52.615758 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:14:52.616575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:14:52.617332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:14:52.618394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:14:52.618895 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:14:52.628283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:52.628903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:52.629342 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:52.630179 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:52.630706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:52.631232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:52.652844 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Getting quotas for project 14201dd9cdf946d2824c31e55c0573f8. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:14:52.657097 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Getting quotas for user e64f94da55234c21889ecf1cd2220ed5 and project 14201dd9cdf946d2824c31e55c0573f8. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:14:52.669020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:14:52.671558 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='67862398-ccf8-4489-ba45-8fa6201ae830',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:14:52.801176 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a05efda2-6c6f-4ddd-b76a-24949fe3f427 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671069 Sep 01 09:14:52.802130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 245/500] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:14:52.809382 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:52.810320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:52.817767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:52.818605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:52.819327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:52.820908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:52.821267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-66828fda-df68-4179-9a08-c92de40ebeab tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:52.821844 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:52.822006 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-66828fda-df68-4179-9a08-c92de40ebeab tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:52.822792 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:52.920005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-66828fda-df68-4179-9a08-c92de40ebeab tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:52.928009 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-66828fda-df68-4179-9a08-c92de40ebeab tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1258 microversion: 2.1 time: 0.118547 Sep 01 09:14:52.929616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 246/501] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:52 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1258 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:53.038683 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:53.050627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:53.052264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:53.054333 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f0cc4167-4c3c-4cbb-add9-63519a7e1413 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.248567 Sep 01 09:14:53.055056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 256/502] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:52 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:14:53.949667 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-87455276-4fce-4aaf-88a4-2349e9662dba tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:53.950279 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-87455276-4fce-4aaf-88a4-2349e9662dba tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:54.008166 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-87455276-4fce-4aaf-88a4-2349e9662dba tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:54.016483 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-87455276-4fce-4aaf-88a4-2349e9662dba tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1258 microversion: 2.1 time: 0.070618 Sep 01 09:14:54.017128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 247/503] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:53 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:54.077966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:54.078674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:54.085123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:54.085616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:54.086051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:54.086744 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:54.087224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:54.087662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:54.237444 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:54.246342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:54.247928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:54.249125 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-72a1bcb5-c7b8-43e2-b242-63198f305ad8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.175117 Sep 01 09:14:54.249883 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 257/504] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:54 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:55.037729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:55.038802 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:55.046008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:55.046503 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:55.046958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:55.047700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:55.048143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:55.048574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:55.119804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:55.128057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f3c05b09-28c7-4f07-812f-509c046f59ca tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.094468 Sep 01 09:14:55.128912 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 248/505] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:55 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:55.272570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:55.273260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:55.279377 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:55.279853 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:55.280289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:55.281001 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:55.281448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:55.281868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:55.419273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:55.436820 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:55.438576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:55.439880 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8f4da68f-56ac-42b8-bc47-2d627fed78b9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.171763 Sep 01 09:14:55.440439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 258/506] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:55 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:56.152393 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:56.164500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:56.164500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:56.164500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:56.164500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:56.164841 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:56.164841 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:56.164841 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:56.229076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:56.237715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-57d0f209-1ca6-4963-97ae-22b970cbdebc tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.088848 Sep 01 09:14:56.238485 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 249/507] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:56 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:56.466464 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:56.467175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:56.474411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:56.476035 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:56.476475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:56.477179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:56.477631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:56.478169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:56.629043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:56.640398 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:56.642060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:56.643455 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2ba823e9-ce0d-4035-9fe4-8b13f846d96d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.182056 Sep 01 09:14:56.644702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 259/508] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:56 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:14:57.259563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:57.260291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:57.268875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:57.269485 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:57.269985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:57.270789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:57.271972 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:57.272474 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:57.292290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:57.342005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:57.351522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7b8f7062-1e99-4a7b-afab-9adc61ab2dfb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.095907 Sep 01 09:14:57.354937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 250/509] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:57 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:14:57.668608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:57.668608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:57.671063 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:14:57.674418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:57.674898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:57.675359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:57.676057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:57.676509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:57.676926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:57.832191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:57.841496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:57.842921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:57.844092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e585b38b-e649-45a4-a91d-efc21e5712b5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.180755 Sep 01 09:14:57.844672 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 260/510] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:57 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:58.373286 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:58.374007 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:58.381067 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:58.381669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:58.382098 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:58.382793 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:58.383289 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:58.383715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:58.451594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:58.458953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-115f6635-c9eb-4595-b596-1a50a1d181fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.089537 Sep 01 09:14:58.459990 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 251/511] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:58 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:14:58.866096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:58.866922 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:58.873279 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:58.873770 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:58.874207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:58.875097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:58.875578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:58.876071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:59.011677 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:59.020917 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:59.022908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:59.024096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-939b5bed-6a9d-4565-9602-bb51f4a18bb6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.162173 Sep 01 09:14:59.024659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 261/512] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:14:58 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:14:59.481127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:14:59.481754 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:14:59.488714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:59.489195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:59.489626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:59.490862 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:14:59.491450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:14:59.491857 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:14:59.558134 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:14:59.566304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f15a0601-55e8-42ee-9df5-46b7e8915144 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.089983 Sep 01 09:14:59.566892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 252/513] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:14:59 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:00.047809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:00.048570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:00.055257 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:00.055751 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:00.056190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:00.056892 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:00.057532 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:00.058038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:00.200271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:00.210615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:00.213675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:00.214047 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-14865f1f-c8b6-4649-bf45-ceab0525b1f4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.170210 Sep 01 09:15:00.215280 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 262/514] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:00 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:00.589177 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:00.589848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:00.596456 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:00.596946 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:00.597522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:00.598210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:00.598659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:00.599081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:00.660726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:00.668740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-872bff9b-af88-4536-b873-5376ad245d3d tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.084484 Sep 01 09:15:00.674748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 253/515] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:00 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:01.239977 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:01.240591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:01.247039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:01.247564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:01.248003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:01.248684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:01.249140 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:01.249568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:01.388005 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:01.396825 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:01.398306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:01.399500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1619aa53-42ef-4883-9e94-95289faf255d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.163548 Sep 01 09:15:01.400063 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 263/516] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:01 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:01.697847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:01.698455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:01.705130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:01.705619 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:01.706059 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:01.706757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:01.707243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:01.707672 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:01.771184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:01.779577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c42001ea-bf3f-42e1-b54a-559652e86d51 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.085508 Sep 01 09:15:01.780171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 254/517] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:01 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:02.423205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:02.423816 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:02.425648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=4 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:02.430898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:02.431415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:02.431850 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:02.432536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:02.432989 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:02.433413 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:02.559299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:02.567871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:02.569967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:02.571159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c4ef180b-bf38-4516-a5c2-d4e4c5c62870 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.151844 Sep 01 09:15:02.571722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 264/518] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:02 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:02.801319 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:02.801963 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:02.804521 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:02.809696 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:02.828165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:02.828165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:02.828165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:02.828165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:02.828556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:02.871321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:02.880680 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1f257354-f655-4c19-a75b-5fd1ca47f95f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.083181 Sep 01 09:15:02.881453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 255/519] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:02 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:03.593821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:03.594447 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:03.601077 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:03.601557 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:03.601992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:03.602672 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:03.603166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:03.610215 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:03.732648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:03.741482 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:03.742936 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:03.744127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64d376dd-341c-42af-9312-aa8cb5dcdca5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.154224 Sep 01 09:15:03.744691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 265/520] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:03 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:03.901761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:03.902378 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:03.909175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:03.909660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:03.910093 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:03.910786 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:03.911279 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:03.911710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:03.973966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:03.981688 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-740b88bf-4bb9-4af2-9fc9-12ce0d890aff tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.083709 Sep 01 09:15:03.982197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 256/521] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:03 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:04.767547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:04.768251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:04.774733 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:04.775251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:04.775689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:04.776368 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:04.776826 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:04.777251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:04.802516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "292dc791-edfd-4750-888b-c00d5679a304"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:04.804992 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:04.806864 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=10 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:04.811814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:04.812304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:04.812755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:04.813441 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:04.813894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:04.814365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:04.904493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:04.914057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:04.915527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:04.916674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-44f0b001-d82c-4eb4-ab2f-9ab41c1cb01a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.152988 Sep 01 09:15:04.917240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 266/522] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:04 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:05.002164 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:05.002828 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:05.008671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:05.009146 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:05.009577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:05.010262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:05.010718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:05.011160 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:05.070788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:05.078286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64a068c2-609b-4315-9c10-09c99e766925 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.079707 Sep 01 09:15:05.078866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 267/523] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:04 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:05.939026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:05.939741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:05.945779 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:05.946266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:05.946702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:05.947497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:05.947950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:05.948374 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:06.077943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:06.086495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:06.087936 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:06.089066 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8c15ee52-1d21-4442-afe3-7d46cbdbf29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.153969 Sep 01 09:15:06.089630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 268/524] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:05 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:06.099924 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:06.100556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:06.106456 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:06.106965 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:06.107464 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:06.108151 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:06.108637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:06.109068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:06.124831 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:06.170526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:06.178440 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-25f06dd8-e934-4cf2-9a4e-ad5d8beb267b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.082721 Sep 01 09:15:06.179010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 269/525] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:06 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:07.112280 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:07.112948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:07.119874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:07.120355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:07.120790 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:07.121471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:07.121929 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:07.122350 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:07.248626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:07.257717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:07.259186 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:07.260348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-831e4aa3-a2f1-42c3-964b-dea9577c111e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.152293 Sep 01 09:15:07.260915 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 270/526] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:07 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:07.265201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:07.265801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:07.271334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:07.271821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:07.272260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:07.272942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:07.273404 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:07.273884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:07.335782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:07.344034 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2e01dc96-8d6e-4579-ae85-fcc2a34661c2 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1262 microversion: 2.1 time: 0.082170 Sep 01 09:15:07.344618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 271/527] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:07 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:07.938201 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-03265cf7-c754-41fd-99a3-0fd15a9f107e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.139404 Sep 01 09:15:07.943925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 257/528] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:15:04 2022] POST /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments => generated 194 bytes in 3141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:15:08.283700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:08.284304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:08.290410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:08.290889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:08.291346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:08.292023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:08.292471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:08.292889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:08.366057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:08.366893 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:08.373182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:08.373601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:08.374037 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:08.374740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:08.375227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:08.375656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:08.425362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:08.435273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:08.436902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:08.438060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0b5a3483-c6fa-4e93-8b19-98a981b17040 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.158556 Sep 01 09:15:08.438624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 272/529] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:08 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:08.438755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:08.447165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fcfa7f5f-22bc-4ac4-8138-dfdadbe2226f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1310 microversion: 2.1 time: 0.085345 Sep 01 09:15:08.447806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 258/530] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:08 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:09.463069 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:09.463714 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:09.468367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:09.470579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:09.476413 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:09.478254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:09.479933 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:09.480841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:09.481022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:09.481519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:09.484106 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:09.484244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:09.484840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:09.485142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:09.485311 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:09.485781 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:09.806773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:09.815828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d50c55ac-09b0-41ed-ac1e-d6d7add6252c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.351705 Sep 01 09:15:09.819033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 259/531] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:09 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:09.862188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:09.873968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:09.889157 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:09.890668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-87dc623e-546d-40ba-b784-929ec38db044 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.432248 Sep 01 09:15:09.891468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 273/532] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:09 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:10.841887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:10.842487 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:10.849278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:10.849774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:10.850208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:10.850900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:10.851382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:10.851806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:10.919591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:10.920505 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:10.928288 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:10.929118 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:10.929568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:10.930353 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:10.930830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:10.931500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:11.000323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:11.008927 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f4036dd9-775d-4d39-9539-9de1a8d5d9c3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.170924 Sep 01 09:15:11.009877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 260/533] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:10 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:11.072367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:11.080880 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:11.082571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:11.083876 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a9da7bea-daa7-4c3e-b89e-c8627bd8e7c5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.168406 Sep 01 09:15:11.084746 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 274/534] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:10 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:12.029997 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:12.030705 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:12.039063 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:12.039710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:12.040218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:12.041033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:12.041577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:12.042104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:12.107209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:12.107968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:12.114678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:12.115176 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:12.115620 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:12.116311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:12.116779 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:12.117204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:12.197735 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:12.207449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-aec3b776-2392-49fe-b3c3-3db7ba70e391 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.181381 Sep 01 09:15:12.208685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 261/535] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:12 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:12.300029 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:12.309435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:12.311300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:12.312671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-36d572aa-b460-4710-8f30-ded88824c5a7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.209573 Sep 01 09:15:12.313409 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 275/536] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:12 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:13.243831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:13.245443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:13.248403 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:13.254053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:13.254604 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:13.255064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:13.255896 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:13.256709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:13.256709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:13.336934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:13.338287 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:13.347394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:13.348150 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:13.348748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:13.349815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:13.351466 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:13.352119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:13.428335 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:13.437762 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-79df2245-3190-4044-a032-20f5fefde67e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.198465 Sep 01 09:15:13.451154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 262/537] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:13 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:13.497107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:13.506313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:13.507942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:13.509491 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ef3f96f7-b779-4db2-ace8-635c1a8fb65a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.176775 Sep 01 09:15:13.510051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 276/538] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:13 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:14.458663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:14.459306 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:14.466355 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:14.466838 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:14.467309 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:14.468001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:14.468456 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:14.468906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:14.531924 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:14.532555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:14.539401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:14.539895 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:14.540330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:14.541036 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:14.541486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:14.542096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:14.610182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:14.618965 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9a63c7d0-0cd0-48be-941f-12cbf7199c82 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.164713 Sep 01 09:15:14.631365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 263/539] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:14 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:14.700452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:14.709763 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:14.711237 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:14.712396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0e4712c7-a7d5-4c38-bd48-40983821d717 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.184613 Sep 01 09:15:14.713073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 277/540] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:14 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:15.641249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:15.643579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:15.650636 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:15.651150 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:15.651594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:15.652331 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:15.653042 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:15.653465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:15.737300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:15.738634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:15.745523 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:15.746000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:15.746431 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:15.747145 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:15.747605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:15.748025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:15.796750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:15.805193 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-642efc6f-0a32-4a4f-a2f3-7b6cde062286 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.168142 Sep 01 09:15:15.805785 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 264/541] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:15 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:15.903486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:15.912745 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:15.914174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:15.915347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7cbeb0d7-95c3-428e-b65c-83092de88edf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.183446 Sep 01 09:15:15.916104 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 278/542] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:15 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:16.826019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:16.826640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:16.833674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:16.834159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:16.834594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:16.835319 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:16.835801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:16.836205 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:16.939922 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:16.940620 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:16.946799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:16.947321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:16.947759 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:16.948444 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:16.948900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:16.949312 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:16.976230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:16.980267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:16.987682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-14ca5ec5-6e1c-4d96-8210-80a83a3177e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.163961 Sep 01 09:15:16.999738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 265/543] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:16 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:17.093764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:17.102768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:17.104430 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:17.106284 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-384b6d39-2259-4375-aeee-943333ee2de4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.170353 Sep 01 09:15:17.117722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 279/544] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:16 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:18.010503 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:18.011141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:18.017899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:18.018380 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:18.018815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:18.019538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:18.019996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:18.020423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:18.129924 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:18.130543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:18.140959 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:18.141454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:18.142580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:18.143416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:18.151905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:18.155251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:18.155531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:18.164433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9940ecce-129e-4e0d-a025-b19dd4a6a789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.157956 Sep 01 09:15:18.165104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 266/545] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:18 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:18.292728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:18.301495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:18.302927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:18.304114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9f83545e-4699-476c-8ae9-358cc2ee26ef tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.178398 Sep 01 09:15:18.304685 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 280/546] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:18 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:19.185311 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:19.185971 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:19.193027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:19.193916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:19.193916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:19.194607 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:19.195066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:19.195518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:19.324893 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:19.326555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:19.327190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:19.332717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0ef10f93-30c5-44bb-a130-aa592e790eeb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.151291 Sep 01 09:15:19.333333 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 267/547] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:19 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:19.333490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:19.333860 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:19.334288 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:19.334975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:19.335453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:19.335867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:19.464114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:19.473250 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:19.474688 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:19.475871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b4576b2a-0a23-4dd5-90c5-41d8b8857dfc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.153106 Sep 01 09:15:19.476437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 281/548] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:19 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:20.354382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:20.355024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:20.362142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:20.362629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:20.363070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:20.363779 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:20.364236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:20.364667 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:20.488482 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:20.496106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3e19ee63-d429-4fed-a4d7-01e2a493cec5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.145598 Sep 01 09:15:20.496677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 268/549] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:20 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:20.498868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:20.499516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:20.505468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:20.505954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:20.506383 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:20.507064 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:20.507537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:20.507958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:20.633295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:20.642439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:20.643916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:20.645064 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cbd9ef03-2d1b-4bb6-8465-be293cac3a9f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.150095 Sep 01 09:15:20.645629 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 282/550] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:20 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:21.517969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:21.518605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:21.526805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:21.527684 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:21.528475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:21.529189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:21.529702 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:21.535980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:21.669556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:21.670196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:21.676914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:21.677405 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:21.677830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:21.678517 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:21.678963 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:21.679415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:21.684187 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:21.693010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4bd0e424-0e51-4c8b-ab18-0496c388b1b1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.179051 Sep 01 09:15:21.693601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 269/551] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:21 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:21.819217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:21.828942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:21.830435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:21.831686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d711c3f6-7213-4023-a92d-52c780fbcbcd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.166190 Sep 01 09:15:21.832266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 283/552] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:21 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:22.714964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:22.715628 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:22.721972 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:22.722448 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:22.722886 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:22.723598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:22.724050 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:22.724477 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:22.849185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:22.856955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8c9e4cc5-e8e4-4ac1-b711-fd42ca2f1671 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.145817 Sep 01 09:15:22.857808 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 270/553] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:22 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:22.858327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:22.859777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:22.866363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:22.866857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:22.867338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:22.868231 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:22.868722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:22.869151 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:22.995818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:23.005300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:23.006746 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:23.008454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-515bc7d7-80b7-4a3b-b848-613d1e8779bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.154061 Sep 01 09:15:23.013004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 284/554] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:22 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:23.879125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:23.879753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:23.886180 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:23.886672 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:23.887125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:23.887831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:23.888329 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:23.888760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:24.022666 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:24.031178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-bcbf56f4-3a29-4755-b093-660ec4c5c4e1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.155861 Sep 01 09:15:24.031400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:24.031899 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:24.037941 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:24.038428 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:24.038864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:24.039586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:24.040041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:24.040873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:24.044314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 271/555] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:23 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:24.251543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:24.260935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:24.262359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:24.263531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7a8afddd-8317-498c-a642-6c4e598e75bc tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.236331 Sep 01 09:15:24.274560 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 285/556] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:24 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:24.361089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-feeb7d65-201a-48f2-87fb-2d99ae18f7fd req-87935ccb-6b34-44fd-a27a-1848528c0f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77faab74-d45f-43e0-98a0-047afa7f4ab1", "tag": "59adb5de-03d0-4adf-8b66-fa4fd1d06955"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:24.370466 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-feeb7d65-201a-48f2-87fb-2d99ae18f7fd req-87935ccb-6b34-44fd-a27a-1848528c0f60 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:24.370949 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-feeb7d65-201a-48f2-87fb-2d99ae18f7fd req-87935ccb-6b34-44fd-a27a-1848528c0f60 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:24.371414 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-feeb7d65-201a-48f2-87fb-2d99ae18f7fd req-87935ccb-6b34-44fd-a27a-1848528c0f60 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:24.382395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-feeb7d65-201a-48f2-87fb-2d99ae18f7fd req-87935ccb-6b34-44fd-a27a-1848528c0f60 service nova] Creating event network-changed:59adb5de-03d0-4adf-8b66-fa4fd1d06955 for instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 on hv-cinder-82002 Sep 01 09:15:24.387449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-feeb7d65-201a-48f2-87fb-2d99ae18f7fd req-87935ccb-6b34-44fd-a27a-1848528c0f60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030164 Sep 01 09:15:24.388039 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 272/557] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:25.052779 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:25.053389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:25.060515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:25.061012 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:25.062709 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:25.063433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:25.063901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:25.064360 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:25.066905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:25.193205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:25.200879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2592288b-8ae9-4a55-b65a-3d830aec1651 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.151889 Sep 01 09:15:25.201453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 286/558] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:25 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:25.288094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:25.288833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:25.294912 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:25.295430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:25.296537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:25.297234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:25.297698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:25.298130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:25.426800 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:25.435345 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:25.437380 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:25.438544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c043b5e2-3ef9-45d3-a9ad-52c1b7e687a5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.155237 Sep 01 09:15:25.439156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 273/559] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:25 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:26.221113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:26.221719 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:26.227902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:26.228376 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:26.228808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:26.229480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:26.229925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:26.230341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:26.358802 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:26.366725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4a188454-243f-4fea-b0d4-b982312d01ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.149452 Sep 01 09:15:26.375150 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 287/560] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:26 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:26.462010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:26.462662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:26.470853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:26.471372 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:26.472051 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:26.473005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:26.473462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:26.474319 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:26.622193 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:26.631929 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:26.633348 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:26.634511 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3b49265b-0aea-4e0d-ba14-5af26ddb17e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.176490 Sep 01 09:15:26.635076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 274/561] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:26 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:27.388586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:27.389904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:27.396054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:27.396843 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:27.397355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:27.398165 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:27.398741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:27.406244 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:27.584377 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:27.593259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8592879e-29cf-41cd-b5e3-1af81dd479ee tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.208468 Sep 01 09:15:27.593835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 288/562] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:27 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:27.658398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:27.658999 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:27.665363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:27.665873 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:27.666304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:27.666983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:27.667465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:27.667889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:27.796472 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:27.804996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:27.806431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:27.807616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dd2c4879-2bd3-4532-9474-18cada78b3e2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.153852 Sep 01 09:15:27.808178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 275/563] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:27 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:28.267048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:28.269333 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:28.271196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=58 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:28.276091 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.276577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.277015 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.277696 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.278152 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.278578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.302795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lazy-loading 'flavor' on Instance uuid d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:15:28.542782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ae1a89d6-deb5-447a-adc3-da28f07e5355 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/action" status: 200 len: 32 microversion: 2.1 time: 0.279867 Sep 01 09:15:28.543846 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 289/564] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:15:28 2022] POST /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 09:15:28.553359 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:28.554009 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:28.560971 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.561491 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.562018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.562713 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.563194 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.563620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.614615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:28.615340 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:28.621437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.621927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.622359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.623601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.624147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.624574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.765612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:28.774000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-27070242-3ef8-4702-914c-c7beedaf14d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.163320 Sep 01 09:15:28.774582 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 290/565] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:28 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:28.814910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:28.823536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f806e2c6-46a8-443c-9cf0-7e25df2eba83 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.273983 Sep 01 09:15:28.824114 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 276/566] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:28 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:28.830723 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:28.831389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:28.837305 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.837794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.838266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.838960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:28.839451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:28.839892 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:28.965975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:28.975646 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:28.977081 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:28.978230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d22e05e2-a934-4108-9439-c08c7b6eea0b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.152464 Sep 01 09:15:28.978781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 291/567] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:28 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:29.796755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:29.797367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:29.803735 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:29.804213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:29.804643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:29.805342 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:29.805794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:29.806213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:29.845759 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:29.846364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:29.852299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:29.852784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:29.853216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:29.854531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:29.854993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:29.855453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:29.935153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:29.942934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-019d4255-1685-4c00-b6a4-50c431ff97a0 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.150662 Sep 01 09:15:29.943542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 277/568] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:29 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:29.987221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:29.995336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-036f30ef-86cb-48fc-b747-ee9548b8e702 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.153291 Sep 01 09:15:29.995903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 292/569] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:29 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:30.000218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:30.000828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:30.006823 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:30.007324 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:30.007756 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:30.008434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:30.008886 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:30.009306 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:30.140176 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:30.149001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:30.150435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:30.151629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-095f5385-4123-466f-86a9-15b3d2d78118 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.155549 Sep 01 09:15:30.152202 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 278/570] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:29 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:30.806187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-3a2dd559-8b98-4cc8-92ff-62dc674a981a req-227a3213-ee8e-44cc-bbfd-78057d17cb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfa76cf-89f5-4112-a5ae-859e051bbe0d", "name": "network-vif-plugged", "status": "completed", "tag": "8bfe0a67-ded1-411e-bbbd-beb319ed33d0"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:30.816317 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3a2dd559-8b98-4cc8-92ff-62dc674a981a req-227a3213-ee8e-44cc-bbfd-78057d17cb06 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:30.816797 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3a2dd559-8b98-4cc8-92ff-62dc674a981a req-227a3213-ee8e-44cc-bbfd-78057d17cb06 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:30.817258 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3a2dd559-8b98-4cc8-92ff-62dc674a981a req-227a3213-ee8e-44cc-bbfd-78057d17cb06 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:30.830286 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-3a2dd559-8b98-4cc8-92ff-62dc674a981a req-227a3213-ee8e-44cc-bbfd-78057d17cb06 service nova] Creating event network-vif-plugged:8bfe0a67-ded1-411e-bbbd-beb319ed33d0 for instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d on hv-cinder-82002 Sep 01 09:15:30.835578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-3a2dd559-8b98-4cc8-92ff-62dc674a981a req-227a3213-ee8e-44cc-bbfd-78057d17cb06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033339 Sep 01 09:15:30.836320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 293/571] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:30.963044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:30.963824 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:30.970879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:30.971464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:30.971982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:30.972749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:30.973376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:30.973859 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:31.017599 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:31.018305 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:31.024628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:31.025116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:31.025552 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:31.026242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:31.026693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:31.027166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:31.107305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:31.115194 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ec88d0d6-4fa7-4d3b-ab9e-b30645f6fdaf tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.155929 Sep 01 09:15:31.115774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 279/572] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:30 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:31.164111 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:31.170654 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cca9ec31-7744-4349-add1-c0edd6534675 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.157816 Sep 01 09:15:31.171262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 294/573] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:31 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:31.174239 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:31.174865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:31.180853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:31.181347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:31.181787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:31.182479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:31.182939 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:31.183395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:31.346555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:31.355419 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:31.357048 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:31.358249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e691dd7b-3b63-4132-87b2-275cf4b777c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.187993 Sep 01 09:15:31.358816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 280/574] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:31 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:15:32.134580 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:32.135120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:32.141952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:32.142432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:32.142865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:32.143578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:32.144025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:32.144446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:32.191737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:32.192376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:32.198613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:32.199093 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:32.199557 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:32.200275 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:32.200725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:32.201154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:32.280138 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:32.287919 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7aa6306f-e4fb-4e82-a8d3-d5b1c8799e24 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.157109 Sep 01 09:15:32.288496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 295/575] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:32 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:32.330504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:32.338741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7ef65550-1710-4443-8e1d-a432086337c6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.150833 Sep 01 09:15:32.339343 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 281/576] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:32 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:32.482556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:32.483200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:32.489132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:32.489617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:32.490057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:32.490743 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:32.491241 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:32.491670 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:32.620174 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:32.629357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:32.630803 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:32.632023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-96a5b18e-859c-4e87-a13c-3009bd15506d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.252720 Sep 01 09:15:32.632677 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 296/577] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:32 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:33.308360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:33.310122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:33.316534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:33.317016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:33.317452 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:33.318143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:33.318595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:33.319019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:33.361478 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:33.362094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:33.368126 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:33.368610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:33.375128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:33.375128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:33.375128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:33.375128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:33.450150 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:33.457812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9e7462d5-5e3d-45da-a304-f0994f97aa59 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.153328 Sep 01 09:15:33.458390 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 282/578] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:33 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:33.500325 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:33.508401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-58a766d7-ec6e-481d-a927-8c61912b9d04 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.151284 Sep 01 09:15:33.508967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 297/579] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:33 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:33.657027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:33.657910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:33.670752 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:33.671298 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:33.671737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:33.672455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:33.672916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:33.673346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:33.690016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:33.804199 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:33.812981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:33.814930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:33.815572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7a3a3196-e5f0-4e13-aa63-988a86fdaf7d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1808 microversion: 2.20 time: 0.164107 Sep 01 09:15:33.816158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 283/580] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:33 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:34.477837 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:34.478711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:34.485313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:34.485819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:34.486240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:34.486956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:34.487439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:34.487867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:34.529781 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:34.530541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:34.537274 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:34.540265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:34.540265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:34.540265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:34.540265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:34.540633 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:34.622126 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:34.630013 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a3a06120-3ef7-4ddb-a6e7-c3fdbb29f2ce tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.155967 Sep 01 09:15:34.636167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 298/581] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:34 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:34.672590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:34.680841 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ae3f369e-6724-4720-a78f-f42230862eb1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.155308 Sep 01 09:15:34.681692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 284/582] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:34 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:34.837766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:34.838370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:34.845013 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:34.845515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:34.845929 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:34.846608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:34.847058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:34.848365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:34.988709 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:34.997417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:34.998889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:35.008921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e1bf1e3f-c33c-4a1e-8285-65c6ea356e8c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1795 microversion: 2.20 time: 0.166184 Sep 01 09:15:35.008921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 299/583] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:15:34 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1795 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:15:35.104599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-62a98aa5-b3cd-43de-9058-527643c60638 req-1564dd58-c29d-4580-aeb1-29bc1bc7f729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77faab74-d45f-43e0-98a0-047afa7f4ab1", "name": "network-vif-plugged", "status": "completed", "tag": "59adb5de-03d0-4adf-8b66-fa4fd1d06955"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:35.114081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-62a98aa5-b3cd-43de-9058-527643c60638 req-1564dd58-c29d-4580-aeb1-29bc1bc7f729 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:35.114566 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-62a98aa5-b3cd-43de-9058-527643c60638 req-1564dd58-c29d-4580-aeb1-29bc1bc7f729 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:35.115002 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-62a98aa5-b3cd-43de-9058-527643c60638 req-1564dd58-c29d-4580-aeb1-29bc1bc7f729 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:35.126408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-62a98aa5-b3cd-43de-9058-527643c60638 req-1564dd58-c29d-4580-aeb1-29bc1bc7f729 service nova] Creating event network-vif-plugged:59adb5de-03d0-4adf-8b66-fa4fd1d06955 for instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 on hv-cinder-82002 Sep 01 09:15:35.131309 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-62a98aa5-b3cd-43de-9058-527643c60638 req-1564dd58-c29d-4580-aeb1-29bc1bc7f729 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030409 Sep 01 09:15:35.131902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 285/584] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:35.652609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:35.653214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:35.659065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:35.659573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:35.660053 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:35.660756 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:35.661205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:35.661624 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:35.704278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:35.704984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:35.711094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:35.711616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:35.712068 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:35.712768 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:35.713226 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:35.713656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:35.789731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:35.797992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-478c7d6d-1ef9-4958-9ae3-8cd0655a8d3b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.149246 Sep 01 09:15:35.798758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 300/585] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:35 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:35.847365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:35.856358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-411a56f9-8296-495f-a8b4-c43816cec1d6 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.157007 Sep 01 09:15:35.856926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 286/586] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:35 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:36.817920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:36.818682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:36.825389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:36.825870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:36.826304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:36.826981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:36.827466 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:36.827888 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:36.842687 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:36.877882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:36.878805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:36.885443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:36.886588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:36.887027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:36.887789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:36.888248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:36.888694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:36.958362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:36.966292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ddedd60e-7d3a-4ee5-a314-ae79a583303f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1358 microversion: 2.1 time: 0.152254 Sep 01 09:15:36.967254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 301/587] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:36 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:36.998602 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:15:36.998837 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 (ip 10.222.0.46) !!! Sep 01 09:15:37.019256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:37.027922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-337a1e7c-e89d-4206-8e89-9695913c8162 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.154000 Sep 01 09:15:37.028476 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 287/588] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:36 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:37.986900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:37.987562 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:37.993660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:37.994136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:37.994566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:37.996010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.001711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.001711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.049204 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:38.049802 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:38.055958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.056444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.056889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.057593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.058181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.058608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.131413 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:38.140495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-91b72f94-088f-4fea-9b7c-5933cca645c4 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1549 microversion: 2.1 time: 0.157506 Sep 01 09:15:38.141081 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 302/589] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:37 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:38.160705 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:38.161487 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:38.168004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.168518 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.168949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.169653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.170111 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.170540 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.194019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:38.203522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-016e22f9-baa5-4be6-992d-79a9044e069d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.158034 Sep 01 09:15:38.204113 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 288/590] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:38 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:38.298625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:38.306358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f060dce6-3f20-413c-82c6-52f995ebb095 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1549 microversion: 2.1 time: 0.149381 Sep 01 09:15:38.306935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 303/591] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:38 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:38.326871 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:38.331671 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:38.332434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Searching by: {'deleted': False, 'project_id': '14201dd9cdf946d2824c31e55c0573f8'} {{(pid=121063) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 09:15:38.339019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.339522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.339955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.340665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.341113 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.341536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.430172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.multi_cell_list [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121063) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 09:15:38.525609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8e38e449-a77f-4508-b573-1936df9ae6f6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203100 Sep 01 09:15:38.526320 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 289/592] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Sep 1 09:15:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:38.537400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:38.538009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:38.544591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.545073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.545509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.546191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:38.546645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:38.547073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:38.678024 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:38.686545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3a0e8013-fa6e-4d1b-b25f-3665e5cf3b8f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1549 microversion: 2.1 time: 0.152955 Sep 01 09:15:38.687316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 304/593] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:38 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:39.225167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:39.225792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:39.233970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:39.234566 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:39.235189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:39.236091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:39.236741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:39.237310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:39.368294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:39.376801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-98ccdfb7-b60e-4f72-8d84-47a03830af55 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.155439 Sep 01 09:15:39.377401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 290/594] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:39 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:40.398685 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:40.399378 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:40.405553 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:40.410870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:40.410870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:40.410870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:40.410870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:40.411339 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:40.541860 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:40.550256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-111be823-ac34-4ef5-ae51-979571e21d21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.155698 Sep 01 09:15:40.550831 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 305/595] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:40 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:41.571178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:41.585120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:41.585120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:41.585120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:41.585120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:41.585494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:41.585494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:41.585494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:41.591808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1b2dcdf-483f-407f-af33-1a757127e1ee"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:41.594193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:41.600329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:41.600814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:41.601250 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:41.601934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:41.602389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:41.602809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:41.717917 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:41.726159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d38a3593-4cbb-48b2-bd77-cb182ca75466 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.158760 Sep 01 09:15:41.726731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 291/596] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:41 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:42.286534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d6fa8bfe-9c49-4238-92e7-47938c55091c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699088 Sep 01 09:15:42.287199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 306/597] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:15:41 2022] POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:15:42.747968 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:42.748585 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:42.754965 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:42.755481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:42.755926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:42.756620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:42.757081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:42.757511 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:42.885175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:42.893260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-24afd3b3-159c-4bd9-b074-86325beb17f7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.149169 Sep 01 09:15:42.893836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 292/598] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:42 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:43.917418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:43.918069 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:43.924341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:43.924826 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:43.925295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:43.925985 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:43.926438 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:43.926864 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:44.059406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:44.067816 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-894526c7-9ba3-4834-be2a-5bcd29e4be2f tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.156083 Sep 01 09:15:44.072136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 307/599] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:43 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:45.089924 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:45.090536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:45.092610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=62 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:45.097249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:45.097729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:45.098168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:45.098851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:45.099340 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:45.099767 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:45.226018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:45.234984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-05b8d18f-5492-4d44-b7fa-56b14f3a1771 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.149099 Sep 01 09:15:45.235583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 293/600] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:45 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:46.257307 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:46.257965 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:46.265424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:46.265903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:46.266334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:46.267013 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:46.267561 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:46.268049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:46.402788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:46.410933 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d7b48120-f2bd-48e9-b353-7bb99acc221d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.157588 Sep 01 09:15:46.411534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 308/601] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:46 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:47.436284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:47.436874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:47.443381 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:47.443856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:47.444287 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:47.444974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:47.445422 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:47.445841 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:47.582186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:47.590971 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2b687da4-d64e-4139-94b5-dd65cf9f4edd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1734 microversion: 2.1 time: 0.158735 Sep 01 09:15:47.591580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 294/602] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:47 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:48.612391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:48.612994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:48.620163 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:48.620726 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:48.621159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:48.621840 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:48.622290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:48.622709 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:48.757105 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:48.765779 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e084ffbc-47e6-4a0f-a43f-ea4519f5a68e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1714 microversion: 2.1 time: 0.157251 Sep 01 09:15:48.766355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 309/603] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:48 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:48.828605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:48.829098 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:48.831146 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:48.836341 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:48.836826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:48.837264 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:48.838676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:48.839269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:48.839703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:48.961643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] HTTP exception thrown: Cannot 'detach_volume' instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 while it is in vm_state rescued Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Request method failure captured: Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments/292dc791-edfd-4750-888b-c00d5679a304 HTTP/1.1 Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcF-34v__ijpg5r_L6XoV5szpExUjxYjZ_MYqWfxdNN5WfuYpdM9xtKyFWCpNbusOHbnv5GIpJ2pdzjZmG1BIlWZNBy8R86JFAYOm2wKyA6h4EvpVWQeXCEmDCrJxStgbmuFK4ZabdMnDc5l96OSVESfAH7TbsvMmaFH160n4LRggM Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:15:48.963408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15f1ee0d68f646bcad60cbf31c3c684d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15f1ee0d68f646bcad60cbf31c3c684d"}]}] Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 81816508df7c431fa3b4b495d11ac101 Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:15:48.964749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Cannot 'detach_volume' instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 while it is in vm_state rescued Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'server_id': 'd0760e1d-3d2e-4eae-b113-78ed44c4f6a4', 'id': '292dc791-edfd-4750-888b-c00d5679a304'} Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:15:48.965464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 while it is in vm_state rescued Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 while it is in vm_state rescued Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:15:48.966792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Returning 409 to user: Cannot 'detach_volume' instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 while it is in vm_state rescued {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:15:48.968406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d96c5772-b2e9-4a23-8936-91cf7624f290 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments/292dc791-edfd-4750-888b-c00d5679a304" status: 409 len: 152 microversion: 2.1 time: 0.140356 Sep 01 09:15:48.968406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 295/604] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:15:48 2022] DELETE /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments/292dc791-edfd-4750-888b-c00d5679a304 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 09:15:48.973953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:48.974481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:48.980428 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:48.980903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:48.981332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:48.982007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:48.982453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:48.982873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:49.137189 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-83696983-18bc-4332-8486-a32f60d9d5a8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "POST /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/action" status: 202 len: 0 microversion: 2.1 time: 0.166716 Sep 01 09:15:49.137740 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 310/605] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:15:48 2022] POST /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:15:49.147057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:49.147717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:49.153794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:49.156189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:49.156189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:49.156189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:49.156189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:49.156578 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:49.285350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:49.294347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3f8365af-cf4d-47c8-ae42-3ed0c965120d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1722 microversion: 2.1 time: 0.152124 Sep 01 09:15:49.295060 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 296/606] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:49 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:50.317301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:50.317987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:50.325087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:50.325566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:50.326002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:50.326676 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:50.327151 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:50.327575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:50.453839 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:50.461924 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-487c7c17-91f6-4c49-a6b7-1d5fc86682b0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1722 microversion: 2.1 time: 0.148790 Sep 01 09:15:50.462495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 311/607] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:50 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:50.925238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:50.925792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:50.933030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:50.933517 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:50.933960 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:50.934658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:50.935127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:50.935584 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:51.065951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:51.074088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-15d7ca74-4251-4c83-af9e-fd4326ee5fec tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1595 microversion: 2.1 time: 0.152802 Sep 01 09:15:51.074649 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 297/608] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:50 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:51.484980 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:51.485593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:51.492153 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:51.492640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:51.493080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:51.494570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:51.495033 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:51.495488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:51.635765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:51.644412 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1cd7a5c0-70bd-42a8-80d0-f52dbef4043a tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1722 microversion: 2.1 time: 0.163493 Sep 01 09:15:51.645024 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 312/609] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:51 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:52.667428 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:52.668044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:52.674307 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:52.674791 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:52.675248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:52.675964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:52.676376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:52.676798 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:52.898480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:52.906624 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0c94badc-3ec2-434d-aff2-4a6460340d77 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1722 microversion: 2.1 time: 0.243818 Sep 01 09:15:52.907209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 298/610] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:52 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:15:53.389328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-5b9d784b-8a08-46a1-abb9-c65844dbded9 req-41cf89e1-552f-4af1-ab68-19e7eaef4373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77faab74-d45f-43e0-98a0-047afa7f4ab1", "tag": "59adb5de-03d0-4adf-8b66-fa4fd1d06955"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:53.399657 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-5b9d784b-8a08-46a1-abb9-c65844dbded9 req-41cf89e1-552f-4af1-ab68-19e7eaef4373 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:53.400163 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-5b9d784b-8a08-46a1-abb9-c65844dbded9 req-41cf89e1-552f-4af1-ab68-19e7eaef4373 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:53.400823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-5b9d784b-8a08-46a1-abb9-c65844dbded9 req-41cf89e1-552f-4af1-ab68-19e7eaef4373 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:53.414122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-5b9d784b-8a08-46a1-abb9-c65844dbded9 req-41cf89e1-552f-4af1-ab68-19e7eaef4373 service nova] Creating event network-changed:59adb5de-03d0-4adf-8b66-fa4fd1d06955 for instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 on hv-cinder-82002 Sep 01 09:15:53.419677 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-5b9d784b-8a08-46a1-abb9-c65844dbded9 req-41cf89e1-552f-4af1-ab68-19e7eaef4373 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094834 Sep 01 09:15:53.420292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 313/611] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:53.934034 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:53.934805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:53.941300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:53.941787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:53.942227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:53.942920 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:53.943401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:53.943829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:54.116350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:54.126369 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8aa19329-a65d-44d7-997b-1caf86340a20 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1728 microversion: 2.1 time: 0.201770 Sep 01 09:15:54.126959 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 299/612] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:53 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:54.156496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:54.157257 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:54.166722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:54.168176 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:54.168861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:54.169650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:54.170184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:54.170949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:54.280488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-278485b0-409e-4cbd-a31b-825d6f71fe57 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132632 Sep 01 09:15:54.281085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 314/613] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:15:54 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:55.436410 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-64c873c8-14ad-4e6a-bc64-692cb1650825 req-b41ccf8b-f8d9-4212-ad6f-d1f332df9d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0760e1d-3d2e-4eae-b113-78ed44c4f6a4", "tag": "6fd3f0b1-2b81-45bc-8411-6aa0f55497df"}, {"name": "network-changed", "server_uuid": "d0760e1d-3d2e-4eae-b113-78ed44c4f6a4", "tag": "6fd3f0b1-2b81-45bc-8411-6aa0f55497df"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:55.447236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-64c873c8-14ad-4e6a-bc64-692cb1650825 req-b41ccf8b-f8d9-4212-ad6f-d1f332df9d70 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:55.447872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-64c873c8-14ad-4e6a-bc64-692cb1650825 req-b41ccf8b-f8d9-4212-ad6f-d1f332df9d70 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:55.448568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-64c873c8-14ad-4e6a-bc64-692cb1650825 req-b41ccf8b-f8d9-4212-ad6f-d1f332df9d70 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:55.464851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:15:55.464851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-64c873c8-14ad-4e6a-bc64-692cb1650825 req-b41ccf8b-f8d9-4212-ad6f-d1f332df9d70 service nova] Creating event network-changed:6fd3f0b1-2b81-45bc-8411-6aa0f55497df for instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 on hv-cinder-82002 Sep 01 09:15:55.464851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-64c873c8-14ad-4e6a-bc64-692cb1650825 req-b41ccf8b-f8d9-4212-ad6f-d1f332df9d70 service nova] Creating event network-changed:6fd3f0b1-2b81-45bc-8411-6aa0f55497df for instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 on hv-cinder-82002 Sep 01 09:15:55.469518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-64c873c8-14ad-4e6a-bc64-692cb1650825 req-b41ccf8b-f8d9-4212-ad6f-d1f332df9d70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038222 Sep 01 09:15:55.470638 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 300/614] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:55.766109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-892003970"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:55.767258 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:55.773307 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:55.774601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:55.775190 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:55.775951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:55.776469 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:55.776958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:56.008757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.network.security_group_api [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Adding security group 1182e2c0-76da-456d-afd0-e33727cb515e to port 59adb5de-03d0-4adf-8b66-fa4fd1d06955 Sep 01 09:15:56.556265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bc371892-c78d-479c-9cbd-6e8a521f292b tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.795222 Sep 01 09:15:56.558911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 315/615] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:15:55 2022] POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/action => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:15:56.573191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:56.573921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:56.580893 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:56.581385 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:56.581826 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:56.582570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:56.583038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:56.584212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:56.641056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-a29c9785-7bda-485f-b9cb-9cd964f07d5c req-251a8a5f-c608-4627-acba-87903c7d3895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77faab74-d45f-43e0-98a0-047afa7f4ab1", "tag": "59adb5de-03d0-4adf-8b66-fa4fd1d06955"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:15:56.655035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a29c9785-7bda-485f-b9cb-9cd964f07d5c req-251a8a5f-c608-4627-acba-87903c7d3895 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:56.655844 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a29c9785-7bda-485f-b9cb-9cd964f07d5c req-251a8a5f-c608-4627-acba-87903c7d3895 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:56.656338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a29c9785-7bda-485f-b9cb-9cd964f07d5c req-251a8a5f-c608-4627-acba-87903c7d3895 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:56.668173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-a29c9785-7bda-485f-b9cb-9cd964f07d5c req-251a8a5f-c608-4627-acba-87903c7d3895 service nova] Creating event network-changed:59adb5de-03d0-4adf-8b66-fa4fd1d06955 for instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 on hv-cinder-82002 Sep 01 09:15:56.673146 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-a29c9785-7bda-485f-b9cb-9cd964f07d5c req-251a8a5f-c608-4627-acba-87903c7d3895 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111546 Sep 01 09:15:56.674128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 301/616] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:15:56.821995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:15:56.835018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f88c0593-ef12-47ad-bf16-38950dae5d9e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1760 microversion: 2.1 time: 0.268551 Sep 01 09:15:56.842838 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 316/617] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:15:56 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1760 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:15:58.220862 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:15:58.221450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:15:58.228346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:58.229110 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:58.229284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:58.229976 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:15:58.230437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:15:58.230914 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:15:58.314904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lazy-loading 'services' on Instance uuid 8be4ee16-c20b-4744-9bb7-94a9afbb5415 {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:15:58.535430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-40892bd6-8520-4e00-a133-d8d53af31380 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-volume_attachments/bac51459-8956-453f-8365-f29e35df5bc9" status: 202 len: 0 microversion: 2.1 time: 0.421791 Sep 01 09:15:58.536388 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 302/618] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:15:58 2022] DELETE /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-volume_attachments/bac51459-8956-453f-8365-f29e35df5bc9 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:16:00.708093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c70af8eb-b87e-4cfe-b3cb-0f3ed98f0b96 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:00.711144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=56 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:00.715790 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c70af8eb-b87e-4cfe-b3cb-0f3ed98f0b96 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:00.716267 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c70af8eb-b87e-4cfe-b3cb-0f3ed98f0b96 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:00.716699 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c70af8eb-b87e-4cfe-b3cb-0f3ed98f0b96 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:00.720097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:00.739038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c70af8eb-b87e-4cfe-b3cb-0f3ed98f0b96 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Going to try to stop instance {{(pid=121062) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 09:16:00.887577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c70af8eb-b87e-4cfe-b3cb-0f3ed98f0b96 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action" status: 202 len: 0 microversion: 2.1 time: 0.182962 Sep 01 09:16:00.888210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 317/619] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:16:00 2022] POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:16:00.897345 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:00.898043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:00.904921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:00.905337 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:00.906061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:00.906937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:00.907476 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:00.907907 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:01.039971 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:01.048745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f1f39e93-711f-44b0-97fc-cadb2d3ab4f5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.155842 Sep 01 09:16:01.049323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 303/620] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:00 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:02.071402 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:02.072090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:02.078541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:02.079017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:02.079479 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:02.080154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:02.080602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:02.081019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:02.210831 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:02.218564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1016d180-0808-48b1-a362-526774fa2300 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.152575 Sep 01 09:16:02.219157 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 318/621] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:02 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:03.239817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:03.240580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:03.247344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:03.247828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:03.248265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:03.248984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:03.249440 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:03.249863 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:03.380689 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:03.388488 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-22ab0da3-c100-46d3-8917-8b6dc5591d23 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.152608 Sep 01 09:16:03.389331 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 304/622] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:03 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:04.409652 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:04.410258 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:04.416414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:04.417452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:04.417452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:04.418017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:04.418465 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:04.418886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:04.549212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:04.557218 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bca70054-bbe1-4328-8486-2cba43f52776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.151369 Sep 01 09:16:04.557801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 319/623] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:04 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:05.578328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:05.578946 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:05.585584 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:05.586069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:05.586514 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:05.587232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:05.587696 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:05.588126 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:05.716920 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:05.725127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8a7c965f-dd48-4bf7-bdfb-17bd768303d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.150826 Sep 01 09:16:05.725704 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 305/624] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:05 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:06.101543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:06.102049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:06.108237 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.108717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.109148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.109857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.110303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.110726 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.133924 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b5557592-819a-4aee-9f4e-aa38d29136b4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5/ips" status: 200 len: 147 microversion: 2.1 time: 0.131135 Sep 01 09:16:06.134473 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 320/625] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:16:06 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5/ips => generated 147 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:06.146631 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fea40e3-9c09-47f7-afe9-a3a96752aed4"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:06.149149 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:06.155015 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.155528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.155961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.156642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.157092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.157511 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.235619 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Invalid volume: volume 5fea40e3-9c09-47f7-afe9-a3a96752aed4 is already attached to instances: af02f0cb-1acf-48dd-8868-42cd5ebfff97 Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: POST /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5/os-volume_attachments HTTP/1.1 Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 74 Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:16:06.237334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {"volumeAttachment": {"volumeId": "5fea40e3-9c09-47f7-afe9-a3a96752aed4"}} Sep 01 09:16:06.238828 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Invalid volume: volume 5fea40e3-9c09-47f7-afe9-a3a96752aed4 is already attached to instances: af02f0cb-1acf-48dd-8868-42cd5ebfff97 Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'server_id': '16aac3dd-aaba-4552-80bd-3673dc9ffbe5', 'body': {'volumeAttachment': {'volumeId': '5fea40e3-9c09-47f7-afe9-a3a96752aed4'}}} Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5fea40e3-9c09-47f7-afe9-a3a96752aed4 is already attached to instances: af02f0cb-1acf-48dd-8868-42cd5ebfff97 Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:06.239720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5fea40e3-9c09-47f7-afe9-a3a96752aed4 is already attached to instances: af02f0cb-1acf-48dd-8868-42cd5ebfff97 Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:06.241079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5fea40e3-9c09-47f7-afe9-a3a96752aed4 is already attached to instances: af02f0cb-1acf-48dd-8868-42cd5ebfff97 Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 400 to user: Invalid volume: volume 5fea40e3-9c09-47f7-afe9-a3a96752aed4 is already attached to instances: af02f0cb-1acf-48dd-8868-42cd5ebfff97 {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e51f99a2-5fce-405e-8d44-7bedb371e642 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096802 Sep 01 09:16:06.242459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 306/626] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:16:06 2022] POST /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:16:06.247833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:06.248334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:06.254218 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.254709 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.255293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.255985 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.256447 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.256876 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.282448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:16:06.539596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dd9495bb-d0a3-4870-bfc9-e0e69ebd138c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 204 len: 0 microversion: 2.1 time: 0.295193 Sep 01 09:16:06.540221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 321/627] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:16:06 2022] DELETE /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 09:16:06.550761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:06.551423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:06.558734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.559382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.559855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.560644 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.561105 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.561534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.691520 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:06.699373 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-943c2aac-f46e-4587-9632-07f600c82679 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1677 microversion: 2.1 time: 0.153712 Sep 01 09:16:06.699948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 307/628] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:06 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:06.746645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:06.747390 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:06.753350 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.753835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.754271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.754961 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:06.755448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:06.755872 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:06.884454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:06.892592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-aaee9243-9d1e-4b65-9794-6b27cfce30ea tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.150104 Sep 01 09:16:06.893168 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 322/629] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:06 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:07.720459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:07.721062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:07.728587 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:07.729127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:07.729560 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:07.730248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:07.730724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:07.731172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:07.861172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:07.868908 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a88d6a62-6b4a-4801-aa4d-07de071c87c6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1677 microversion: 2.1 time: 0.152339 Sep 01 09:16:07.869487 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 308/630] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:07 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:07.914370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:07.914983 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:07.921384 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:07.921865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:07.922329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:07.923015 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:07.923500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:07.923928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:08.052869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:08.060518 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-595a0629-57b1-4ca5-86ed-7d197654f305 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.150722 Sep 01 09:16:08.061057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 323/631] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:07 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:08.890106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:08.890720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:08.898147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:08.898569 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:08.899008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:08.899736 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:08.900195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:08.900621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:09.081057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:09.081698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:09.088574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:09.089060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:09.089493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:09.090182 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:09.090645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:09.091073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:09.105888 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:09.114447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-97919b8c-3975-44ab-9bbc-f21cc55dfa69 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1677 microversion: 2.1 time: 0.227760 Sep 01 09:16:09.115180 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 309/632] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:08 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:09.222752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:09.230486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3fae1447-ce13-448f-b3cd-ea7247c41f6a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.153306 Sep 01 09:16:09.231060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 324/633] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:09 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:16:09.545465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-1a550b04-9267-4d9a-bd7f-fb9610067cea req-82d9dba0-d18d-4825-85ec-b48b87d0f4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16aac3dd-aaba-4552-80bd-3673dc9ffbe5", "name": "network-vif-deleted", "tag": "ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:09.556242 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1a550b04-9267-4d9a-bd7f-fb9610067cea req-82d9dba0-d18d-4825-85ec-b48b87d0f4f8 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:09.556503 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1a550b04-9267-4d9a-bd7f-fb9610067cea req-82d9dba0-d18d-4825-85ec-b48b87d0f4f8 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:09.556968 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1a550b04-9267-4d9a-bd7f-fb9610067cea req-82d9dba0-d18d-4825-85ec-b48b87d0f4f8 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:09.569510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-1a550b04-9267-4d9a-bd7f-fb9610067cea req-82d9dba0-d18d-4825-85ec-b48b87d0f4f8 service nova] Creating event network-vif-deleted:ec8e1614-ad49-41d4-9ec8-f014fd8c1cb2 for instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 on hv-cinder-82002 Sep 01 09:16:09.575417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-1a550b04-9267-4d9a-bd7f-fb9610067cea req-82d9dba0-d18d-4825-85ec-b48b87d0f4f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Sep 01 09:16:09.576334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 310/634] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:10.136098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:10.138403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:10.144874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:10.145608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:10.146103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:10.146769 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:10.147260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:10.147691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:10.184273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:10.184843 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:10.185288 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:10.185776 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'fault' on Instance uuid 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:16:10.231020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:10.240490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b6cd92a4-5e54-4677-a755-5c320d56060e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 200 len: 1329 microversion: 2.1 time: 0.108232 Sep 01 09:16:10.241460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 325/635] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:10 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:10.255008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:10.259988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:10.267838 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:10.268557 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:10.269191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:10.271043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:10.271537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:10.271971 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:10.414705 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:10.422886 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cd27154b-7559-459f-985d-abdff3773282 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.174230 Sep 01 09:16:10.423758 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 311/636] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:10 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:11.264078 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:11.264701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:11.271735 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:11.272251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:11.272676 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:11.273392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:11.273855 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:11.274284 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:11.289334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 HTTP/1.1 Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:16:11.291037 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:16:11.292585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '16aac3dd-aaba-4552-80bd-3673dc9ffbe5'} Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:16:11.293328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:16:11.294526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:16:11.295694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:16:11.295694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-335f049b-afb3-4ba4-8189-2f0ecd909a04 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 404 len: 111 microversion: 2.1 time: 0.032684 Sep 01 09:16:11.295694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 326/637] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:11 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:16:11.302349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ab314438-1a48-4bf3-a781-4a9477671c39 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '.version_select at 0x7f7a65443670>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:11.402255 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ab314438-1a48-4bf3-a781-4a9477671c39 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-73024492" status: 202 len: 0 microversion: 2.1 time: 0.104442 Sep 01 09:16:11.402856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 312/638] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Sep 1 09:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-73024492 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:16:11.447368 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:11.453744 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:11.471179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:11.472030 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:11.474009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:11.477416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:11.478088 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:11.478607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:11.634354 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:11.642957 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8c28c146-a035-4755-b88d-8c98a71834cd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1675 microversion: 2.1 time: 0.201011 Sep 01 09:16:11.657123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 327/639] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:11 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:12.488084 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:12.488598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:12.495185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:12.495676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:12.496117 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:12.496809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:12.497299 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:12.497726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:12.579706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'services' on Instance uuid af02f0cb-1acf-48dd-8868-42cd5ebfff97 {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:16:12.664139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:12.664773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:12.670810 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:12.682272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:12.682272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:12.682272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:12.682272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:12.683136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:12.783049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6c47017b-b7bf-4e57-837f-cb05a55923ee tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments/5fea40e3-9c09-47f7-afe9-a3a96752aed4" status: 202 len: 0 microversion: 2.1 time: 0.299251 Sep 01 09:16:12.784423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 313/640] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:16:12 2022] DELETE /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments/5fea40e3-9c09-47f7-afe9-a3a96752aed4 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:16:12.792725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:12.795052 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:12.801816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:12.802314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:12.802469 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:12.802755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:12.803666 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:12.804151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:12.804764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:12.810454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9dc3e594-95e1-43f9-a98a-3761cd4b2b72 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1652 microversion: 2.1 time: 0.150311 Sep 01 09:16:12.811030 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 328/641] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:12 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:16:12.831206 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-422b9af1-7bbb-4a0b-af4d-9be53aa6efe1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:12.836734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c8053222-f35d-4fc4-b60b-9607f882733d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048157 Sep 01 09:16:12.837324 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 314/642] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:16:12 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:16:12.837650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-422b9af1-7bbb-4a0b-af4d-9be53aa6efe1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:12.838272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-422b9af1-7bbb-4a0b-af4d-9be53aa6efe1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:12.838628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-422b9af1-7bbb-4a0b-af4d-9be53aa6efe1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:12.860536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-422b9af1-7bbb-4a0b-af4d-9be53aa6efe1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Going to try to start instance {{(pid=121062) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 09:16:13.060758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-422b9af1-7bbb-4a0b-af4d-9be53aa6efe1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action" status: 202 len: 0 microversion: 2.1 time: 0.233141 Sep 01 09:16:13.061357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 329/643] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:16:12 2022] POST /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 09:16:13.070719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:13.071499 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:13.077417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:13.077907 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:13.078369 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:13.079071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:13.079557 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:13.079987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:13.211827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:13.219525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4b5d06ce-6508-4279-8aec-35ce0f821f3f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1661 microversion: 2.1 time: 0.153936 Sep 01 09:16:13.220101 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 315/644] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:13 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:13.850901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:13.853338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:13.859465 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:13.859954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:13.860390 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:13.861091 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:13.861545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:13.861971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:13.890408 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:13.893857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cb6125be-bb58-4fb2-8643-12588d08a4be tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Sep 01 09:16:13.894416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 330/645] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:16:13 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:14.241264 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:14.241979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:14.248290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:14.248773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:14.249210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:14.249938 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:14.250394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:14.250821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:14.380887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:14.388829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0802970f-bd92-4ab2-9d26-fd8d92e5cce4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1661 microversion: 2.1 time: 0.151660 Sep 01 09:16:14.389408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 316/646] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:14 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:14.906240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:14.908449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:14.916292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:14.916776 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:14.917213 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:14.917900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:14.918356 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:14.918777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:14.948670 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-122d943d-734a-4bda-ae64-e5ced3eb8d10 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046320 Sep 01 09:16:14.949148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 331/647] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:16:14 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:16:15.009600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:15.010106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:15.016298 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:15.016787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:15.017229 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:15.017928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:15.018411 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:15.018843 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:15.043594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:16:15.069937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:15.245855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:15.308955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c4d341ba-d2cc-49e4-9449-7a95a7ec0faa tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 204 len: 0 microversion: 2.1 time: 0.302845 Sep 01 09:16:15.309570 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 317/648] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:16:15 2022] DELETE /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:16:15.317972 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:15.321971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:15.325521 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:15.326000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:15.326432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:15.327134 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:15.327592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:15.328017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:15.411180 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:15.411916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:15.418218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:15.418717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:15.419162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:15.419861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:15.420321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:15.420749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:15.461060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:15.469027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fec4b565-6f9e-4f84-b4bd-549709f985c8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1679 microversion: 2.1 time: 0.155121 Sep 01 09:16:15.469617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 332/649] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:15 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:15.554973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:15.562751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9f34b517-00dd-4faf-a145-8700b8ea8d48 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1665 microversion: 2.1 time: 0.156695 Sep 01 09:16:15.563350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 318/650] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:15 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:16:16.491917 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:16.492525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:16.498960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:16.499474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:16.499907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:16.500628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:16.501086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:16.501509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:16.632656 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:16.640548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a2f3946a-3250-4c93-aee6-46e3e9222d44 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1679 microversion: 2.1 time: 0.154416 Sep 01 09:16:16.641131 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 333/651] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:16 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:17.310332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-b77c2429-9336-4427-923d-604e6216c7bd req-cb932216-22cc-47af-9f96-03cd78d579a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af02f0cb-1acf-48dd-8868-42cd5ebfff97", "name": "network-vif-deleted", "tag": "3e896214-f87a-4a12-8bad-a6d953a69c92"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:17.321723 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b77c2429-9336-4427-923d-604e6216c7bd req-cb932216-22cc-47af-9f96-03cd78d579a6 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:17.324821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b77c2429-9336-4427-923d-604e6216c7bd req-cb932216-22cc-47af-9f96-03cd78d579a6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:17.324821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b77c2429-9336-4427-923d-604e6216c7bd req-cb932216-22cc-47af-9f96-03cd78d579a6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:17.337715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-b77c2429-9336-4427-923d-604e6216c7bd req-cb932216-22cc-47af-9f96-03cd78d579a6 service nova] Creating event network-vif-deleted:3e896214-f87a-4a12-8bad-a6d953a69c92 for instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 on hv-cinder-82002 Sep 01 09:16:17.343190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-b77c2429-9336-4427-923d-604e6216c7bd req-cb932216-22cc-47af-9f96-03cd78d579a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Sep 01 09:16:17.344359 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 319/652] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:17.665564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:17.666222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:17.672520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:17.672998 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:17.673431 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:17.674160 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:17.674607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:17.675026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:17.708238 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:17.708719 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:17.709147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:17.709612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'fault' on Instance uuid af02f0cb-1acf-48dd-8868-42cd5ebfff97 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:16:17.752353 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:17.760683 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1b5d1681-4585-47c5-8428-c37e8fa428f9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 200 len: 1330 microversion: 2.1 time: 0.100007 Sep 01 09:16:17.761275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 334/653] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:17 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:18.782212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:18.783563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:18.790116 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:18.790595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:18.791025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:18.791774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:18.792219 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:18.797286 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:18.806673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 HTTP/1.1 Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:16:18.808346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:16:18.809951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'af02f0cb-1acf-48dd-8868-42cd5ebfff97'} Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:16:18.810860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:16:18.812383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:18.813695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:16:18.813695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f5fecb22-b3ec-4dff-aa7f-0f49d7c80418 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 404 len: 111 microversion: 2.1 time: 0.031707 Sep 01 09:16:18.813695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 320/654] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:18 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:16:18.818592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c3f24dc3-abd3-4762-af92-0c7ad31bd953 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '.version_select at 0x7f7a654d0430>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:18.891575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c3f24dc3-abd3-4762-af92-0c7ad31bd953 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299141689" status: 202 len: 0 microversion: 2.1 time: 0.076680 Sep 01 09:16:18.892675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 335/655] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 09:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299141689 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:16:19.652566 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d064f2dd-e8a8-4de2-9d91-773758715a5a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: .version_select at 0x7f7a652fd280>, body: {"keypair": {"name": "tempest-keypair-101262563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1b/zZDkBwc5+Wl95Y9yoXc1k59tsRoghUywJcFFQHUVSNnrDdXn307UfputLWhTKktVLGqTPs3HcJmTdTqwDuO1ud5uwu+LEfPzvMM5Qpe8w07b6G7gg8C4ChklkzTtQ=="}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:19.667695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-d064f2dd-e8a8-4de2-9d91-773758715a5a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:16:19.671476 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-d064f2dd-e8a8-4de2-9d91-773758715a5a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:16:19.738062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d064f2dd-e8a8-4de2-9d91-773758715a5a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089532 Sep 01 09:16:19.738662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 321/656] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:16:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:22.010809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-178423817", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d95d47db-eb5b-4df8-8295-e8765bcebf85"}], "security_groups": [{"name": "tempest-securitygroup--1551723241"}], "key_name": "tempest-keypair-101262563", "user_data": "}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:22.111593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] validate_networks() for [('d95d47db-eb5b-4df8-8295-e8765bcebf85', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:16:22.522679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:16:22.523182 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:16:22.523652 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:16:22.524064 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:16:22.524475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:16:22.533330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:22.533748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:22.534184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:22.534902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:22.535379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:22.535810 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:22.552279 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:16:22.556381 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:16:22.567951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:16:22.570252 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:16:22.692164 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ef8ade81-9073-4a2c-b158-2f534da9362c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686323 Sep 01 09:16:22.692996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 336/657] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:16:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:16:22.704244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c421606c-36c1-40f2-8383-97ba31f6a2ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:22.704849 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c421606c-36c1-40f2-8383-97ba31f6a2ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:22.763621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c421606c-36c1-40f2-8383-97ba31f6a2ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:22.770504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c421606c-36c1-40f2-8383-97ba31f6a2ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1240 microversion: 2.1 time: 0.070729 Sep 01 09:16:22.771195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 322/658] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:22 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:23.790992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:23.791718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:23.802492 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:23.803329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:23.804056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:23.805196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:23.805945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:23.806654 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:23.872276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:23.880149 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8b2d92b5-ffbf-41f2-843b-553688b4d453 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1244 microversion: 2.1 time: 0.093321 Sep 01 09:16:23.880654 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 337/659] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:23 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:24.901644 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:24.902290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:24.909539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:24.910023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:24.910456 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:24.911178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:24.911630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:24.912053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:24.982948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:24.991877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-84887856-e57d-45b9-b484-937a738c8577 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1300 microversion: 2.1 time: 0.093969 Sep 01 09:16:25.002797 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 323/660] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:24 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:26.013710 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:26.014332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:26.021548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:26.021957 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:26.022389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:26.023073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:26.023547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:26.024005 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:26.157986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:26.165688 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0e9e5a72-3d37-44b9-a94e-9ee381383d4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.155870 Sep 01 09:16:26.166312 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 338/661] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:26 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:26.476944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-307e2d79-21c9-4fe5-b7cb-1ae34164c466 req-655909a6-eb38-4c1e-b685-8aa04fb1b3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73bc5ef-57fb-47a3-844d-b8a0f88c4c12", "tag": "5782f04f-9081-48a1-8077-fa5e3c9f2115"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:26.487993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-307e2d79-21c9-4fe5-b7cb-1ae34164c466 req-655909a6-eb38-4c1e-b685-8aa04fb1b3dd service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:26.488505 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-307e2d79-21c9-4fe5-b7cb-1ae34164c466 req-655909a6-eb38-4c1e-b685-8aa04fb1b3dd service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:26.489425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-307e2d79-21c9-4fe5-b7cb-1ae34164c466 req-655909a6-eb38-4c1e-b685-8aa04fb1b3dd service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:26.500573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-307e2d79-21c9-4fe5-b7cb-1ae34164c466 req-655909a6-eb38-4c1e-b685-8aa04fb1b3dd service nova] Creating event network-changed:5782f04f-9081-48a1-8077-fa5e3c9f2115 for instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 on hv-cinder-82002 Sep 01 09:16:26.505626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-307e2d79-21c9-4fe5-b7cb-1ae34164c466 req-655909a6-eb38-4c1e-b685-8aa04fb1b3dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032416 Sep 01 09:16:26.509947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 324/662] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:27.186704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:27.187522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:27.193946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:27.194429 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:27.194870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:27.195656 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:27.196183 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:27.196609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:27.334068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:27.341613 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-da900cb5-665b-4b02-8e73-6b8b056af160 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.158722 Sep 01 09:16:27.342185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 339/663] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:27 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:28.364711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:28.365552 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:28.371673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:28.372153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:28.372583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:28.373267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:28.373719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:28.374173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:28.501307 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:28.509205 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0994f2d3-7330-4b31-b0d8-eff2d465f248 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.149214 Sep 01 09:16:28.509775 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 325/664] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:28 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:29.530633 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:29.531295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:29.538162 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:29.538639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:29.539071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:29.539780 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:29.540232 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:29.540652 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:29.666526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:29.674167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-efb477ab-7f0f-440f-bcfd-584545f6cae8 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.147901 Sep 01 09:16:29.674734 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 340/665] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:29 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:30.694097 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:30.694719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:30.701156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:30.701637 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:30.702073 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:30.703661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:30.704156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:30.704586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:30.834197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:30.841833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-11950478-3c70-4da0-91ae-650caff3476a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.151551 Sep 01 09:16:30.842430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 326/666] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:30 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:31.862555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:31.863201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:31.865534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:31.870334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:31.870818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:31.871300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:31.871993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:31.872450 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:31.872879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:32.002189 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:32.010094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cae2de2e-b812-4339-8120-dad0bcd45cec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.151477 Sep 01 09:16:32.011627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 341/667] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:31 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:33.033111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:33.033717 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:33.036225 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:33.040970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:33.041446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:33.041878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:33.042559 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:33.043007 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:33.043481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:33.179291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:33.189772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-423b5947-cef2-49d1-8a65-78935f508001 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.159547 Sep 01 09:16:33.189772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 327/668] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:33 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:16:33.321546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:33.322298 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:33.383170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-b2065494-0568-4269-ae62-4a76e6cc8bc9 req-e80daba1-41bf-4d3a-8a0d-5b4db19d64c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73bc5ef-57fb-47a3-844d-b8a0f88c4c12", "name": "network-vif-plugged", "status": "completed", "tag": "5782f04f-9081-48a1-8077-fa5e3c9f2115"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:33.392838 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-b2065494-0568-4269-ae62-4a76e6cc8bc9 req-e80daba1-41bf-4d3a-8a0d-5b4db19d64c2 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:33.393329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-b2065494-0568-4269-ae62-4a76e6cc8bc9 req-e80daba1-41bf-4d3a-8a0d-5b4db19d64c2 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:33.393789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-b2065494-0568-4269-ae62-4a76e6cc8bc9 req-e80daba1-41bf-4d3a-8a0d-5b4db19d64c2 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:33.407489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-b2065494-0568-4269-ae62-4a76e6cc8bc9 req-e80daba1-41bf-4d3a-8a0d-5b4db19d64c2 service nova] Creating event network-vif-plugged:5782f04f-9081-48a1-8077-fa5e3c9f2115 for instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 on hv-cinder-82002 Sep 01 09:16:33.412495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-b2065494-0568-4269-ae62-4a76e6cc8bc9 req-e80daba1-41bf-4d3a-8a0d-5b4db19d64c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095390 Sep 01 09:16:33.413101 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 342/669] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:34.209351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:34.209963 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:34.216601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:34.217080 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:34.218001 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:34.218821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:34.219294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:34.219715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:34.351090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:34.360394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e376f223-d2cf-46d3-ada4-8e9cb4a6d680 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.154902 Sep 01 09:16:34.360974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 328/670] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:34 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:35.382654 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:35.383424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:35.389585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:35.389999 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:35.390433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:35.391118 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:35.391572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:35.391991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:35.522079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:35.529778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d02bacd0-e792-4577-bba9-82d10a01f1c0 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1366 microversion: 2.1 time: 0.151893 Sep 01 09:16:35.530352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 343/671] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:35 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:36.550243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:36.550888 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:36.557494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:36.557976 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:36.558419 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:36.559130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:36.559590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:36.560018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:36.692730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:36.700577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-09957172-2afd-44ea-8d27-09d34471fd1a tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1556 microversion: 2.1 time: 0.154560 Sep 01 09:16:36.701151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 329/672] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:16:36 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:36.721766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:36.722241 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:36.728584 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:36.729060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:36.729497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:36.730171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:36.730621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:36.731038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:36.807313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cf851b02-d8c1-4e4d-9070-9fee73968086 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089854 Sep 01 09:16:36.807905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 344/673] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:16:36 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:37.777426 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-ef122d67-09c4-4140-8f5f-eaa621485893 req-209dc99e-83f1-43c4-93f0-1f2133008d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73bc5ef-57fb-47a3-844d-b8a0f88c4c12", "tag": "5782f04f-9081-48a1-8077-fa5e3c9f2115"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:37.787558 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-ef122d67-09c4-4140-8f5f-eaa621485893 req-209dc99e-83f1-43c4-93f0-1f2133008d67 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:37.788029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-ef122d67-09c4-4140-8f5f-eaa621485893 req-209dc99e-83f1-43c4-93f0-1f2133008d67 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:37.788457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-ef122d67-09c4-4140-8f5f-eaa621485893 req-209dc99e-83f1-43c4-93f0-1f2133008d67 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:37.799554 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-ef122d67-09c4-4140-8f5f-eaa621485893 req-209dc99e-83f1-43c4-93f0-1f2133008d67 service nova] Creating event network-changed:5782f04f-9081-48a1-8077-fa5e3c9f2115 for instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 on hv-cinder-82002 Sep 01 09:16:37.804837 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-ef122d67-09c4-4140-8f5f-eaa621485893 req-209dc99e-83f1-43c4-93f0-1f2133008d67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030921 Sep 01 09:16:37.805384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 330/674] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:42.124682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:42.125246 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:42.131348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:42.131832 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:42.132270 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:42.132952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:42.133405 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:42.133829 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:42.164095 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5245522e-725f-4982-90ac-4d77c072269a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments/e46cc0eb-a5e8-4af9-b32f-c4f246b2c63d" status: 200 len: 194 microversion: 2.20 time: 0.045008 Sep 01 09:16:42.164671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 345/675] 10.222.0.46 () {60 vars in 1454 bytes} [Thu Sep 1 09:16:42 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments/e46cc0eb-a5e8-4af9-b32f-c4f246b2c63d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:16:42.231583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:42.232784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:42.238870 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:42.239387 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:42.239823 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:42.240507 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:42.240960 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:42.241406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:42.320671 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lazy-loading 'services' on Instance uuid 2cfa76cf-89f5-4112-a5ae-859e051bbe0d {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:16:42.512497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dc745e68-5ef3-40a6-b3ce-e9b7059bf2bb tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments/e46cc0eb-a5e8-4af9-b32f-c4f246b2c63d" status: 202 len: 0 microversion: 2.20 time: 0.285525 Sep 01 09:16:42.513877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 331/676] 10.222.0.46 () {60 vars in 1457 bytes} [Thu Sep 1 09:16:42 2022] DELETE /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments/e46cc0eb-a5e8-4af9-b32f-c4f246b2c63d => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:16:42.522359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:42.524636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:42.530555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:42.531042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:42.531519 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:42.532210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:42.532665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:42.533088 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:42.563393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-25f890d6-bf19-4c3b-a206-1fac6389695f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044910 Sep 01 09:16:42.563953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 346/677] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 09:16:42 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:16:43.577404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:43.580299 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:43.586346 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:43.586829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:43.587283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:43.588002 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:43.588452 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:43.588872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:43.618833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c358f227-1c86-4ede-9308-5e479f50513f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046285 Sep 01 09:16:43.619352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 332/678] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 09:16:43 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:16:44.631821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:44.634014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:44.640695 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:44.641211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:44.641650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:44.642378 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:44.642835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:44.643299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:44.672755 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cbf18893-d602-4d3c-ab9f-1ab75bf243c3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045184 Sep 01 09:16:44.673305 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 347/679] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 09:16:44 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:16:44.735137 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:44.735630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:44.741955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:44.742443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:44.742884 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:44.743603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:44.744066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:44.744495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:44.769595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:16:45.073098 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-736ac79b-c67c-4c7a-afd5-45130f14267e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 204 len: 0 microversion: 2.20 time: 0.342301 Sep 01 09:16:45.073692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 333/680] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 09:16:44 2022] DELETE /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 09:16:45.082700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:45.083349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:45.089386 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:45.089868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:45.090308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:45.090994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:45.091488 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:45.091915 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:45.224076 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:45.232028 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:45.233496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:45.234960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-274f55e0-d92d-4519-8b54-7581b8e7db75 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.156284 Sep 01 09:16:45.235581 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 348/681] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:45 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:46.258815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:46.259533 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:46.261865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:46.266681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:46.267207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:46.267656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:46.268344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:46.268801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:46.269226 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:46.273830 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=84,nova_cell1:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:46.400873 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:46.409519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:46.410951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:46.412145 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-45e0c919-c75f-482a-8f5e-d5e75f07c3d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.157680 Sep 01 09:16:46.412709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 334/682] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:46 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:47.435894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:47.437324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:47.443685 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:47.444428 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:47.444867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:47.445548 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:47.445994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:47.446411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:47.450444 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=96 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:16:47.580965 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:47.588923 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:47.590357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:47.591557 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-10777769-a7c9-41ed-a361-c824df1bbc2f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1723 microversion: 2.20 time: 0.159581 Sep 01 09:16:47.592121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 349/683] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:47 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:48.280603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-627e8a52-bb58-4b61-9a6f-8adb8def7476 req-218cd2ae-16ef-4f33-a813-9e9e3c23125d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfa76cf-89f5-4112-a5ae-859e051bbe0d", "name": "network-vif-deleted", "tag": "8bfe0a67-ded1-411e-bbbd-beb319ed33d0"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:48.291549 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-627e8a52-bb58-4b61-9a6f-8adb8def7476 req-218cd2ae-16ef-4f33-a813-9e9e3c23125d service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:48.294046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-627e8a52-bb58-4b61-9a6f-8adb8def7476 req-218cd2ae-16ef-4f33-a813-9e9e3c23125d service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:48.294046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-627e8a52-bb58-4b61-9a6f-8adb8def7476 req-218cd2ae-16ef-4f33-a813-9e9e3c23125d service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:48.303680 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-627e8a52-bb58-4b61-9a6f-8adb8def7476 req-218cd2ae-16ef-4f33-a813-9e9e3c23125d service nova] Creating event network-vif-deleted:8bfe0a67-ded1-411e-bbbd-beb319ed33d0 for instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d on hv-cinder-82002 Sep 01 09:16:48.308783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-627e8a52-bb58-4b61-9a6f-8adb8def7476 req-218cd2ae-16ef-4f33-a813-9e9e3c23125d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032952 Sep 01 09:16:48.309728 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 335/684] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:48.614500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:48.615049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:48.621597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:48.626543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:48.626543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:48.626543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:48.626543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:48.626976 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:48.659619 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:48.660111 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:48.660549 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:48.660999 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lazy-loading 'fault' on Instance uuid 2cfa76cf-89f5-4112-a5ae-859e051bbe0d {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:16:48.706217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:48.714952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:48.718067 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:48.718067 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3cb510c0-b17d-451f-94dc-2d61cb3d7751 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 200 len: 1371 microversion: 2.20 time: 0.107216 Sep 01 09:16:48.718753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 350/685] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:48 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:49.741952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:49.742640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:49.748822 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:49.749298 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:49.749733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:49.750411 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:49.750863 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:49.751320 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:49.764970 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] HTTP exception thrown: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Request method failure captured: Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d HTTP/1.1 Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcGlE_ApwWREQ1_FaCCpmJ-ewYZXBgbMXenO369rLsdWNNFySdzxm0j1EktrVf9N9CAYyCnTlzGRGZ4zUb3qVTastVg8TCwaaM6la4mRX0vx3qQc0U5ohe03p4ow-5XsGeVqiD2t4yj6knp3RD1xb4lYLIkcQ37RxwVZaDpIWmyH8g Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:16:49.766574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b8799a08d0684b5c8d9cd3f89c3016d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b8799a08d0684b5c8d9cd3f89c3016d7"}]}] Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 3d931a379404433b9c3c690dd9beb83d Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:16:49.768277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '2cfa76cf-89f5-4112-a5ae-859e051bbe0d'} Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:16:49.769218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:16:49.770663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:16:49.772088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Returning 404 to user: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:16:49.772088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e4192903-1e7f-4f9f-bc92-e7ee4a24b5d0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 404 len: 111 microversion: 2.20 time: 0.030738 Sep 01 09:16:49.772088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 336/686] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:49 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:16:49.777141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-52ac2068-850f-4f95-9721-e869cef92976 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '.version_select at 0x7f7a654740d0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:49.884198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-52ac2068-850f-4f95-9721-e869cef92976 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-258519305" status: 204 len: 0 microversion: 2.20 time: 0.110673 Sep 01 09:16:49.884710 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 351/687] 10.222.0.46 () {60 vars in 1259 bytes} [Thu Sep 1 09:16:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-258519305 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 09:16:50.661116 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ca75c39e-83f3-412f-94d6-5460a2a6d1d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'create', calling method: .version_select at 0x7f7a65443040>, body: {"keypair": {"name": "tempest-keypair-1031958469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqG5cPTTW5+9bJxLc+9WUmXDYL0FURzTCjuKu16MXLjV+1V+Z+lNRdrWI5pys9hhHcRo0dgMPzunX+m5vCwRgXGMBL6Fm6g25+ZKHVLS0ioQxjqjA2/vTEyEHfznDynMw=="}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:50.677028 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ca75c39e-83f3-412f-94d6-5460a2a6d1d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:16:50.680784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ca75c39e-83f3-412f-94d6-5460a2a6d1d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for user 3d931a379404433b9c3c690dd9beb83d and project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:16:50.782556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ca75c39e-83f3-412f-94d6-5460a2a6d1d2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.125326 Sep 01 09:16:50.783194 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 337/688] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Sep 1 09:16:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 09:16:52.780741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-990727197", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c04be92-b1d0-4cd9-b4e5-6bb7a8617d5d"}], "security_groups": [{"name": "tempest-securitygroup--1414445924"}], "key_name": "tempest-keypair-1031958469", "user_data": "}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:52.885717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] validate_networks() for [('1c04be92-b1d0-4cd9-b4e5-6bb7a8617d5d', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:16:53.255757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:16:53.256175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:16:53.256642 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:16:53.257090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:16:53.257509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:16:53.266806 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:53.267318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:53.267752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:53.268461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:53.268912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:53.269332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:53.285836 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:16:53.289752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Getting quotas for user 3d931a379404433b9c3c690dd9beb83d and project b8799a08d0684b5c8d9cd3f89c3016d7. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:16:53.301360 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:16:53.303644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:16:53.423481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-86e17f04-c357-45aa-a82f-2bd1fde4c7c1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.648203 Sep 01 09:16:53.424148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 352/689] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Sep 1 09:16:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 09:16:53.436434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f12cffed-640f-4f76-acea-cf52c250e6d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:53.437049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f12cffed-640f-4f76-acea-cf52c250e6d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:53.492323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f12cffed-640f-4f76-acea-cf52c250e6d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:53.500349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f12cffed-640f-4f76-acea-cf52c250e6d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:53.502072 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f12cffed-640f-4f76-acea-cf52c250e6d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:53.504315 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f12cffed-640f-4f76-acea-cf52c250e6d9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1281 microversion: 2.20 time: 0.072092 Sep 01 09:16:53.504315 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 338/690] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:53 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:54.526716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:54.527381 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:54.535626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:54.544804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:54.544804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:54.544804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:54.544804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:54.545187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:54.600763 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:54.609918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:54.611394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:54.612495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c6e1dfab-7439-4b4d-ba1e-13b072d8df70 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1277 microversion: 2.20 time: 0.090356 Sep 01 09:16:54.613058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 353/691] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:54 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:55.634954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:55.635617 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:55.642563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:55.643047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:55.643508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:55.644242 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:55.644831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:55.645254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:55.730291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:55.737168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:55.738631 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:55.739769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-bd555392-235b-4fa3-b995-baab2ef895df tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1341 microversion: 2.20 time: 0.108981 Sep 01 09:16:55.740332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 339/692] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:55 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1341 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:56.763193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:56.763809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:56.771017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:56.771783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:56.772220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:56.772916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:56.773375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:56.773800 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:56.902239 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:56.911493 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:56.914707 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:56.914707 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4167e9ac-d2ed-4659-a774-5674f2c076fd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.155192 Sep 01 09:16:56.914959 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 354/693] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:56 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:57.155792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-a20ff3a9-6d53-458e-94cc-dc234ca4a215 req-38c66496-e5a0-4ee8-bc8b-4db9ad7166d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e798b2fb-1903-448d-b38e-5e8c48dfc9eb", "tag": "1ec1e41f-a73b-40d9-a062-d63261502fdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:16:57.165774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a20ff3a9-6d53-458e-94cc-dc234ca4a215 req-38c66496-e5a0-4ee8-bc8b-4db9ad7166d4 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:57.166310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a20ff3a9-6d53-458e-94cc-dc234ca4a215 req-38c66496-e5a0-4ee8-bc8b-4db9ad7166d4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:57.166747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a20ff3a9-6d53-458e-94cc-dc234ca4a215 req-38c66496-e5a0-4ee8-bc8b-4db9ad7166d4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:57.178030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-a20ff3a9-6d53-458e-94cc-dc234ca4a215 req-38c66496-e5a0-4ee8-bc8b-4db9ad7166d4 service nova] Creating event network-changed:1ec1e41f-a73b-40d9-a062-d63261502fdc for instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb on hv-cinder-82002 Sep 01 09:16:57.185070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-a20ff3a9-6d53-458e-94cc-dc234ca4a215 req-38c66496-e5a0-4ee8-bc8b-4db9ad7166d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031457 Sep 01 09:16:57.185070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 340/694] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:16:57.938140 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:57.938746 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:57.946134 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:57.946611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:57.947040 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:57.947765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:57.948218 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:57.948641 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:58.080061 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:58.088009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:58.089439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:58.090660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5bdbf100-9560-45b7-8e9f-46dec6414613 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.157208 Sep 01 09:16:58.091243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 355/695] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:57 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:16:59.113613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:16:59.114308 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:16:59.120812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:59.121368 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:59.121826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:59.122509 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:16:59.122961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:16:59.123433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:16:59.251457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:59.259423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:59.263120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:16:59.263120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c9580f04-23ad-4b2f-889b-6b968d702533 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.153709 Sep 01 09:16:59.263532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 341/696] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:16:59 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:00.285904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:00.286507 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:00.293545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:00.294019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:00.294448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:00.295146 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:00.295918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:00.296500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:00.423121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:00.431057 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:00.437117 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:00.437117 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3875aadd-3042-40f8-b39f-6c3e0a90233d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.151700 Sep 01 09:17:00.437117 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 356/697] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:00 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:01.456124 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:01.456643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:01.463068 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:01.463733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:01.464318 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:01.465067 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:01.465553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:01.465975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:01.594918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:01.602969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:01.604445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:01.606133 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-acc307ba-d3f3-4338-8ebc-6875198dfd02 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.154070 Sep 01 09:17:01.606707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 342/698] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:01 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:01.680619 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:01.681121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:01.688202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:01.688694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:01.689141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:01.689830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:01.690287 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:01.690713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:01.812575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lazy-loading 'services' on Instance uuid d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:17:02.097717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3359d1b9-47e3-42ec-ad85-fde709ccf751 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments/292dc791-edfd-4750-888b-c00d5679a304" status: 202 len: 0 microversion: 2.1 time: 0.420819 Sep 01 09:17:02.098315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 357/699] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:17:01 2022] DELETE /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments/292dc791-edfd-4750-888b-c00d5679a304 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:17:02.108218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:02.110350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:02.116530 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:02.117008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:02.117442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:02.118125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:02.118573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:02.119071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:02.148470 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-53e93e7d-cbc0-481a-9d31-27b24e5d6977 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Sep 01 09:17:02.149033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 343/700] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:17:02 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:02.629543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:02.630265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:02.632225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:02.637735 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:02.638211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:02.638645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:02.639357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:02.639807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:02.640231 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:02.771295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:02.779743 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:02.781173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:02.782263 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1b021c94-204a-4bd7-b5d8-778d21024a09 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.157292 Sep 01 09:17:02.782820 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 358/701] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:02 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:03.161682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:03.163857 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:03.170720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:03.171456 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:03.176906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:03.176906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:03.176906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:03.176906 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:03.202979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-00f45161-fd16-4884-b15d-e5e9a24cea14 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Sep 01 09:17:03.205601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 344/702] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:17:03 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:03.458195 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-ca911036-c3f9-4d58-908f-37ec2cc0caba req-1a0b2750-8813-4b2f-b89b-67119ef7da96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e798b2fb-1903-448d-b38e-5e8c48dfc9eb", "name": "network-vif-plugged", "status": "completed", "tag": "1ec1e41f-a73b-40d9-a062-d63261502fdc"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:03.464840 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:03.466041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:03.470004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-ca911036-c3f9-4d58-908f-37ec2cc0caba req-1a0b2750-8813-4b2f-b89b-67119ef7da96 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:03.470480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-ca911036-c3f9-4d58-908f-37ec2cc0caba req-1a0b2750-8813-4b2f-b89b-67119ef7da96 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:03.470913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-ca911036-c3f9-4d58-908f-37ec2cc0caba req-1a0b2750-8813-4b2f-b89b-67119ef7da96 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:03.482605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-ca911036-c3f9-4d58-908f-37ec2cc0caba req-1a0b2750-8813-4b2f-b89b-67119ef7da96 service nova] Creating event network-vif-plugged:1ec1e41f-a73b-40d9-a062-d63261502fdc for instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb on hv-cinder-82002 Sep 01 09:17:03.487547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-ca911036-c3f9-4d58-908f-37ec2cc0caba req-1a0b2750-8813-4b2f-b89b-67119ef7da96 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Sep 01 09:17:03.488290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 359/703] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:03.804254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:03.804854 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:03.806771 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:03.811665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:03.812180 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:03.812683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:03.813413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:03.813857 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:03.814280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:03.956770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:03.962128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:03.964242 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:03.965330 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-74f9e624-9376-4501-959a-b1e443d514a1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.165001 Sep 01 09:17:03.965899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 345/704] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:03 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:04.217060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:04.219321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:04.226044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.226522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.226955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:04.227668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.228120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.228539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:04.257686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b9adc877-3f6b-4dec-af23-518f8a898c1b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045972 Sep 01 09:17:04.258241 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 360/705] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:17:04 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:17:04.336056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:04.336589 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:04.343053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.343577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.344017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:04.344714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.345173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.345624 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:04.371516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:17:04.617783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-41ae716c-a43d-4b8e-98eb-06e75063d0dd tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 204 len: 0 microversion: 2.1 time: 0.285246 Sep 01 09:17:04.618370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 346/706] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:17:04 2022] DELETE /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:17:04.631188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:04.631188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:04.633654 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.634154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.634589 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:04.635302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.635754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.636858 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:04.764101 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:04.771780 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-958d9737-7a67-4668-ab66-172b14509ca4 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1688 microversion: 2.1 time: 0.148807 Sep 01 09:17:04.772353 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 361/707] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:04 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:04.988532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:04.989159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:04.995055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.996434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.996882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:04.997575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:04.998038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:04.998469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:05.137442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:05.145721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:05.147249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:05.148383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7276e633-103b-4edb-ade3-7076491a223f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.164185 Sep 01 09:17:05.149086 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 347/708] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:04 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:05.793087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:05.793694 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:05.800127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:05.800612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:05.801050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:05.801738 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:05.802196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:05.802628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:05.928158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:05.935880 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b427361f-3aef-4617-acbc-d08cc24b40a7 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1688 microversion: 2.1 time: 0.146628 Sep 01 09:17:05.936454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 362/709] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:05 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:06.171853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:06.171853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:06.177929 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:06.178411 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:06.178850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:06.179571 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:06.180033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:06.180522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:06.308294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:06.316428 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:06.317863 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:06.319010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-215a76c5-bce2-45b6-bda8-6b36ed82610c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.152653 Sep 01 09:17:06.319597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 348/710] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:06 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:06.957723 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:06.958253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:06.965311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:06.965793 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:06.966235 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:06.966921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:06.967428 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:06.967861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:07.098630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:07.107586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1addc0cc-7094-4015-a61a-8d7e25fec7fe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1688 microversion: 2.1 time: 0.153718 Sep 01 09:17:07.108173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 363/711] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:06 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:07.342195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:07.342810 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:07.349813 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:07.350299 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:07.350739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:07.351455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:07.351917 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:07.352348 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:07.483733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:07.491905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:07.493344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:07.494458 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dbe907b8-503b-4989-99d4-e0fabb0347e1 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.156764 Sep 01 09:17:07.495801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 349/712] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:07 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:07.952103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:07.954372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:07.960324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:07.960889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:07.961212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:07.961887 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:07.962334 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:07.962749 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:08.128427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:08.129036 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:08.134993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:08.135588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:08.136016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:08.136694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:08.137149 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:08.137567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:08.170166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-af5d6fb4-0811-41bd-b7bb-cd5bc77f7e65 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.221933 Sep 01 09:17:08.170886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 364/713] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:17:07 2022] POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:17:08.179504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:08.180273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:08.187375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:08.187868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:08.188312 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:08.189012 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:08.189472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:08.189904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:08.268444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:08.276778 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b4f96f0d-36cc-49ab-8e48-ec2206517d51 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1688 microversion: 2.1 time: 0.152031 Sep 01 09:17:08.277482 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 350/714] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:08 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:08.333382 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:08.342291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-67bc18b7-5149-4bf8-a923-d9f4fc03dae1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1752 microversion: 2.1 time: 0.167019 Sep 01 09:17:08.342858 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 365/715] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:08 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:08.517712 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:08.518317 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:08.524817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:08.525289 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:08.526208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:08.526888 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:08.527372 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:08.527790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:08.662619 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:08.671483 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:08.673078 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:08.674211 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dd08df68-d1c3-4d61-b3d4-3331187f5132 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1407 microversion: 2.20 time: 0.160430 Sep 01 09:17:08.674784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 351/716] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:08 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:09.298407 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:09.299015 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:09.305536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.306003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.306438 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.307718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.308205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.308625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.311298 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:09.363259 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:09.363880 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:09.370645 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.371218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.371666 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.372394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.372853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.373554 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.445541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:09.453640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9c05b480-e7e3-4d64-bdab-414ca211d399 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1688 microversion: 2.1 time: 0.159378 Sep 01 09:17:09.454225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 366/717] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:09 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:09.549955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:09.559060 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-387b7228-11e9-4a87-897d-c741b4c999e5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1752 microversion: 2.1 time: 0.199750 Sep 01 09:17:09.559679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 352/718] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:09 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:09.696291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:09.698451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:09.704253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.705051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.705640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.707249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.707712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.708140 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.920161 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:09.928684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:09.930274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:09.931675 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8c83d15e-e267-4bba-babf-f615c0e594c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1599 microversion: 2.20 time: 0.239538 Sep 01 09:17:09.932517 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 367/719] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:17:09 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1599 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:17:09.954715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:09.955251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:09.965737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.967003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.967349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.968415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:09.969484 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:09.969918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:09.974973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:10.245004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c351aa30-7b66-4393-a230-f8cc5fad1fa4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.294970 Sep 01 09:17:10.245630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 353/720] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Sep 1 09:17:09 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-interface => generated 285 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:17:10.474489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:10.475718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:10.483611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:10.484331 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:10.484782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:10.485541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:10.486049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:10.486485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:10.583162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:10.584385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:10.593447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:10.595943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:10.595943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:10.595943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:10.597018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:10.597530 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:10.823451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:10.835476 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4fe04d39-fc7b-4ae3-8590-851a22217f34 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.258241 Sep 01 09:17:10.836081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 354/721] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:10 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:10.842494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-347dac02-db65-48bb-a606-ecdfcdaffc06 req-329b3272-b864-4f1d-86dc-ee8bfb1b06a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0760e1d-3d2e-4eae-b113-78ed44c4f6a4", "name": "network-vif-deleted", "tag": "6fd3f0b1-2b81-45bc-8411-6aa0f55497df"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:10.854815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:10.863755 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ed316dc7-d924-42d1-ad37-a90611ed53b8 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1621 microversion: 2.1 time: 0.393031 Sep 01 09:17:10.865874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 368/722] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:10 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1621 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:10.876102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-347dac02-db65-48bb-a606-ecdfcdaffc06 req-329b3272-b864-4f1d-86dc-ee8bfb1b06a5 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:10.876682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-347dac02-db65-48bb-a606-ecdfcdaffc06 req-329b3272-b864-4f1d-86dc-ee8bfb1b06a5 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:10.877336 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-347dac02-db65-48bb-a606-ecdfcdaffc06 req-329b3272-b864-4f1d-86dc-ee8bfb1b06a5 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:10.895621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-347dac02-db65-48bb-a606-ecdfcdaffc06 req-329b3272-b864-4f1d-86dc-ee8bfb1b06a5 service nova] Creating event network-vif-deleted:6fd3f0b1-2b81-45bc-8411-6aa0f55497df for instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 on hv-cinder-82002 Sep 01 09:17:10.901996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-347dac02-db65-48bb-a606-ecdfcdaffc06 req-329b3272-b864-4f1d-86dc-ee8bfb1b06a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064484 Sep 01 09:17:10.902888 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 355/723] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:11.583591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-643e3566-946c-4951-ab13-54a8bb110d07 req-ce12c384-906f-47b6-993e-4e46735cab08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e798b2fb-1903-448d-b38e-5e8c48dfc9eb", "tag": "1ec1e41f-a73b-40d9-a062-d63261502fdc"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:11.594165 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-643e3566-946c-4951-ab13-54a8bb110d07 req-ce12c384-906f-47b6-993e-4e46735cab08 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:11.595058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-643e3566-946c-4951-ab13-54a8bb110d07 req-ce12c384-906f-47b6-993e-4e46735cab08 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:11.595633 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-643e3566-946c-4951-ab13-54a8bb110d07 req-ce12c384-906f-47b6-993e-4e46735cab08 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:11.611278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-643e3566-946c-4951-ab13-54a8bb110d07 req-ce12c384-906f-47b6-993e-4e46735cab08 service nova] Creating event network-changed:1ec1e41f-a73b-40d9-a062-d63261502fdc for instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb on hv-cinder-82002 Sep 01 09:17:11.617600 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-643e3566-946c-4951-ab13-54a8bb110d07 req-ce12c384-906f-47b6-993e-4e46735cab08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037545 Sep 01 09:17:11.618291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 369/724] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:11.859796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:11.861228 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:11.867785 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:11.868537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:11.869766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:11.870706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:11.871405 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:11.872039 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:11.887094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:11.887814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:11.899611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:11.900442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:11.901351 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:11.902288 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:11.902963 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:11.903620 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:11.970052 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:11.976371 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:11.977085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:11.977892 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lazy-loading 'fault' on Instance uuid d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:17:12.031403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:12.048367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8fbb43c5-1784-4249-9826-2f089dd0af21 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 200 len: 1335 microversion: 2.1 time: 0.165880 Sep 01 09:17:12.049568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 370/725] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:11 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 1335 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:12.207900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:12.217078 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6dc3d294-2db0-48ce-b73c-3a39a4396988 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.361950 Sep 01 09:17:12.217691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 356/726] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:11 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:13.070572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:13.071210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: d0760e1d-3d2e-4eae-b113-78ed44c4f6a4] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:13.078377 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:13.078858 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:13.079345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:13.080025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:13.080474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:13.080895 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:13.094200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] HTTP exception thrown: Instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 could not be found. Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Request method failure captured: Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 HTTP/1.1 Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHcF-34v__ijpg5r_L6XoV5szpExUjxYjZ_MYqWfxdNN5WfuYpdM9xtKyFWCpNbusOHbnv5GIpJ2pdzjZmG1BIlWZNBy8R86JFAYOm2wKyA6h4EvpVWQeXCEmDCrJxStgbmuFK4ZabdMnDc5l96OSVESfAH7TbsvMmaFH160n4LRggM Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:17:13.095805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15f1ee0d68f646bcad60cbf31c3c684d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15f1ee0d68f646bcad60cbf31c3c684d"}]}] Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 81816508df7c431fa3b4b495d11ac101 Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 could not be found. Sep 01 09:17:13.097343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'd0760e1d-3d2e-4eae-b113-78ed44c4f6a4'} Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 could not be found. Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:13.098379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 could not be found. Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 could not be found. Sep 01 09:17:13.099934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:13.101279 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Returning 404 to user: Instance d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:13.101279 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9591bdac-a23a-4231-9976-fc1507cce59e tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4" status: 404 len: 111 microversion: 2.1 time: 0.030540 Sep 01 09:17:13.101279 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 371/727] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:13 2022] GET /compute/v2.1/servers/d0760e1d-3d2e-4eae-b113-78ed44c4f6a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:13.105979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6d2c84be-f4b1-4080-8058-bdfcf64c7eab tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '.version_select at 0x7f7a6528b3a0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:13.188333 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6d2c84be-f4b1-4080-8058-bdfcf64c7eab tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605699803" status: 202 len: 0 microversion: 2.1 time: 0.086359 Sep 01 09:17:13.188887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 357/728] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 09:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605699803 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:17:13.238378 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:13.238987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:13.245745 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:13.246234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:13.246682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:13.247415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:13.248140 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:13.248566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:13.409588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:13.418140 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-27ac6a76-ba1f-4b1f-b7fb-96cfddd9574f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.183820 Sep 01 09:17:13.418708 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 372/729] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:13 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:14.440571 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:14.441191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:14.448334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:14.448819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:14.449254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:14.449966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:14.450417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:14.450844 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:14.744942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:14.744942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4c75edf5-799c-4c53-b971-d62c1dd23f17 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.171582 Sep 01 09:17:14.744942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 358/730] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:14 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:15.631048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:15.631780 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:15.638674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:15.639185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:15.639618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:15.640298 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:15.640748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:15.641351 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:15.784148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:15.792482 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ba83265b-c013-4516-99a3-5b78059d5205 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.165418 Sep 01 09:17:15.793043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 373/731] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:15 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:16.426899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:16.427455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:16.434386 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:16.434876 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:16.435349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:16.436042 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:16.436501 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:16.436931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:16.462251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:17:16.723312 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fa4bf8bb-c353-4d41-99a4-e8fd8a629256 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 204 len: 0 microversion: 2.1 time: 0.299931 Sep 01 09:17:16.723945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 359/732] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:17:16 2022] DELETE /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:17:16.732801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:16.733415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:16.739869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:16.740353 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:16.740789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:16.741476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:16.741938 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:16.742365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:16.814450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:16.815160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:16.821341 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:16.821824 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:16.822354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:16.823160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:16.823620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:16.824171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:16.877451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:16.885210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9fb27ce4-8994-4792-ba48-4c7029ce177c tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1505 microversion: 2.1 time: 0.157157 Sep 01 09:17:16.885788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 374/733] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:16 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:16.971822 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:16.980566 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dac50c2c-1f83-40d5-a4fa-e7e689c3e6e7 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.170408 Sep 01 09:17:16.985947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 360/734] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:16 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:17.905893 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:17.906511 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:17.913240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:17.913730 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:17.914170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:17.914861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:17.915345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:17.915782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:18.001398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:18.002621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:18.009558 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:18.010128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:18.010796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:18.012090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:18.012090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:18.012564 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:18.046981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:18.054614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-aa331d57-7a4f-45d1-8390-2c5f03f6a8c1 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1505 microversion: 2.1 time: 0.152653 Sep 01 09:17:18.057175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 375/735] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:17 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:18.208753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:18.217054 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-08792640-df24-4749-b84d-0be4ddc3e776 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.219488 Sep 01 09:17:18.217642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 361/736] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:17 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:18.249635 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-fa57dd29-1f76-49ee-89f5-edd414eef31d req-444d8c68-1fa2-482d-8343-c31bc59a3670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20653d8d-9ed3-47c2-baa8-63e3ba1725bf", "name": "network-vif-deleted", "tag": "c121e215-1c32-40c0-8a1e-fd1bc8f17a7d"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:18.258873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-fa57dd29-1f76-49ee-89f5-edd414eef31d req-444d8c68-1fa2-482d-8343-c31bc59a3670 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:18.261102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-fa57dd29-1f76-49ee-89f5-edd414eef31d req-444d8c68-1fa2-482d-8343-c31bc59a3670 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:18.261102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-fa57dd29-1f76-49ee-89f5-edd414eef31d req-444d8c68-1fa2-482d-8343-c31bc59a3670 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:18.271179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-fa57dd29-1f76-49ee-89f5-edd414eef31d req-444d8c68-1fa2-482d-8343-c31bc59a3670 service nova] Creating event network-vif-deleted:c121e215-1c32-40c0-8a1e-fd1bc8f17a7d for instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf on hv-cinder-82002 Sep 01 09:17:18.276383 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-fa57dd29-1f76-49ee-89f5-edd414eef31d req-444d8c68-1fa2-482d-8343-c31bc59a3670 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030583 Sep 01 09:17:18.279136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 376/737] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:17:19.076679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:19.077206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:19.079616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:19.084268 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:19.084753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:19.085190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:19.085878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:19.086338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:19.086765 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:19.119035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:19.120100 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:19.120537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:19.120981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lazy-loading 'fault' on Instance uuid 20653d8d-9ed3-47c2-baa8-63e3ba1725bf {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:17:19.161456 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:19.169350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-65b99e8b-7fb7-415a-804d-c1b031aeccd2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 200 len: 1310 microversion: 2.1 time: 0.097540 Sep 01 09:17:19.169925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 362/738] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:19 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:19.240860 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:19.241563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:19.248789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:19.249266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:19.249697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:19.250379 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:19.250834 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:19.251335 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:19.396949 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:19.406065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-810e3c42-e566-4d80-981a-5380892cb789 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.169879 Sep 01 09:17:19.406662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 377/739] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:19 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:20.191422 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:20.192066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 20653d8d-9ed3-47c2-baa8-63e3ba1725bf] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:20.198919 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.199444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.199922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.200628 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.201084 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.201510 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.215455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] HTTP exception thrown: Instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf could not be found. Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Request method failure captured: Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf HTTP/1.1 Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcF-34v__ijpg5r_L6XoV5szpExUjxYjZ_MYqWfxdNN5WfuYpdM9xtKyFWCpNbusOHbnv5GIpJ2pdzjZmG1BIlWZNBy8R86JFAYOm2wKyA6h4EvpVWQeXCEmDCrJxStgbmuFK4ZabdMnDc5l96OSVESfAH7TbsvMmaFH160n4LRggM Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:17:20.217083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15f1ee0d68f646bcad60cbf31c3c684d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15f1ee0d68f646bcad60cbf31c3c684d"}]}] Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 81816508df7c431fa3b4b495d11ac101 Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf could not be found. Sep 01 09:17:20.218948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '20653d8d-9ed3-47c2-baa8-63e3ba1725bf'} Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf could not be found. Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:20.219839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf could not be found. Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf could not be found. Sep 01 09:17:20.221328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:20.222764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Returning 404 to user: Instance 20653d8d-9ed3-47c2-baa8-63e3ba1725bf could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:20.222764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ffc5f93a-dcff-40ce-b0fa-3ac32faa9bc0 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf" status: 404 len: 111 microversion: 2.1 time: 0.031432 Sep 01 09:17:20.222764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 363/740] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:20 2022] GET /compute/v2.1/servers/20653d8d-9ed3-47c2-baa8-63e3ba1725bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:20.226918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:20.227450 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:20.233997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.234485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.234930 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.235648 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.236110 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.236541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.262140 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:17:20.427362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:20.427972 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:20.434592 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.435184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.435650 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.436333 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.436789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.437214 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.512732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a7295ea5-747d-4ce4-8987-98bc0ffb9503 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 204 len: 0 microversion: 2.1 time: 0.289171 Sep 01 09:17:20.513308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 378/741] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:17:20 2022] DELETE /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:17:20.521868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:20.522744 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:20.529526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.530016 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.530456 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.531185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:20.531650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:20.532081 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:20.588350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:20.596659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b01afacb-6055-4c70-bd72-3039188b3adb tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.173275 Sep 01 09:17:20.597236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 364/742] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:20 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:20.664775 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:20.673300 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-34055ee8-5ff1-4549-9815-742a9ad78730 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.155641 Sep 01 09:17:20.673874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 379/743] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:20 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:21.618609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:21.619432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:21.626152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:21.626640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:21.627081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:21.627799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:21.628260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:21.628687 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:21.694059 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:21.694670 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:21.702264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:21.702752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:21.703220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:21.703912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:21.704367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:21.704794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:21.770352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:21.778655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-576070bb-b36d-4863-a657-f83aa6cfde20 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.164530 Sep 01 09:17:21.779251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 365/744] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:21 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:21.836214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:21.844194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7502ea02-46a6-4267-a606-382ce7471895 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.154033 Sep 01 09:17:21.844761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 380/745] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:21 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:22.801292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:22.801905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:22.808925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:22.809350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:22.809788 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:22.810470 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:22.810925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:22.811386 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:22.865753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:22.866350 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:22.874700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:22.875221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:22.876608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:22.877311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:22.877765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:22.878188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:22.965183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:22.973952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b87802f2-77b7-48d0-8993-3ddf2bf578b5 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1757 microversion: 2.1 time: 0.176474 Sep 01 09:17:22.974542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 366/746] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:22 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:23.016115 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:23.024616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-37f7a52f-db47-4ad9-8f2b-b3c96786b5e2 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.162108 Sep 01 09:17:23.028955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 381/747] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:22 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:23.891526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:23.893674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:23.900233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:23.900724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:23.901159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:23.901848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:23.902303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:23.902729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:23.932060 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0237c542-6a1b-4d52-84c2-bd1e38512c43 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044422 Sep 01 09:17:23.932637 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 367/748] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:17:23 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:17:23.996012 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:23.996606 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:23.997752 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:23.997876 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:24.003133 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.003620 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.003997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.004129 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.004727 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.005180 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.005486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.005615 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.006039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.006799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.007521 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.008010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.034439 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:17:24.037609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:24.254437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:24.264232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1dbb9c63-3aeb-4402-9319-1dc127628c0c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1760 microversion: 2.1 time: 0.273034 Sep 01 09:17:24.264826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 368/749] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:23 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1760 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:24.269691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:24.270229 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:24.276194 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.276686 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.277131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.277855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.278383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.278827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.377534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ec4609db-8299-48a6-a3c0-f2217015d2a4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 204 len: 0 microversion: 2.1 time: 0.383319 Sep 01 09:17:24.377534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 382/750] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:17:23 2022] DELETE /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:17:24.384449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:24.385277 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:24.391261 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.391751 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.392186 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.392880 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.393341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.393771 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.464553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:24.474563 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-48afd897-b6f4-4338-9824-3974d71d3166 tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1521 microversion: 2.1 time: 0.208664 Sep 01 09:17:24.487130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 369/751] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:24 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:24.536452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:24.547463 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ad4b9410-9660-45d9-9ea2-06c655d66cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1671 microversion: 2.1 time: 0.167522 Sep 01 09:17:24.551175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 383/752] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:24 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:24.635894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-23108cb3-bf24-4f54-8541-cceeed17a566 req-1e51eb6a-a4f1-4361-b300-6ef488d9c324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c3385c-4154-40a0-bebe-a0f7be2dcc9b", "name": "network-vif-deleted", "tag": "6445032a-1aa0-485e-8a04-f0d6555b85e8"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:24.645144 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-23108cb3-bf24-4f54-8541-cceeed17a566 req-1e51eb6a-a4f1-4361-b300-6ef488d9c324 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:24.645615 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-23108cb3-bf24-4f54-8541-cceeed17a566 req-1e51eb6a-a4f1-4361-b300-6ef488d9c324 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:24.646044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-23108cb3-bf24-4f54-8541-cceeed17a566 req-1e51eb6a-a4f1-4361-b300-6ef488d9c324 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:24.657143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-23108cb3-bf24-4f54-8541-cceeed17a566 req-1e51eb6a-a4f1-4361-b300-6ef488d9c324 service nova] Creating event network-vif-deleted:6445032a-1aa0-485e-8a04-f0d6555b85e8 for instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b on hv-cinder-82002 Sep 01 09:17:24.661880 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-23108cb3-bf24-4f54-8541-cceeed17a566 req-1e51eb6a-a4f1-4361-b300-6ef488d9c324 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030767 Sep 01 09:17:24.662449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 370/753] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:25.501180 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:25.501870 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:25.508539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:25.509236 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:25.509680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:25.510387 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:25.510845 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:25.511303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:25.572900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:25.573699 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:25.580919 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:25.581811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:25.582418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:25.583590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:25.584230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:25.585559 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:25.587092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:25.591900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:25.595900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-43525eb5-c4c0-4495-8772-546ec48feafe tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1307 microversion: 2.1 time: 0.098816 Sep 01 09:17:25.596753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 384/754] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:25 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:25.749590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:25.758637 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5300bfde-6d06-4740-aa9e-20f09d2fa45b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1671 microversion: 2.1 time: 0.190262 Sep 01 09:17:25.759347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 371/755] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:25 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:26.618681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:26.620207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:26.626494 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:26.627130 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:26.627568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:26.628302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:26.628792 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:26.629216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:26.671621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:26.671621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:26.671621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:26.671621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lazy-loading 'fault' on Instance uuid 85c3385c-4154-40a0-bebe-a0f7be2dcc9b {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:17:26.713802 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81816508df7c431fa3b4b495d11ac101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f1ee0d68f646bcad60cbf31c3c684d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:26.722109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-21a70a28-c7cd-4374-bb0b-648fea3af19b tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 200 len: 1312 microversion: 2.1 time: 0.108182 Sep 01 09:17:26.732774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 385/756] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:26 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:26.780635 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:26.781350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:26.788355 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:26.798480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:26.798480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:26.798480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:26.798480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:26.798844 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:26.877246 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:26.885468 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b927f036-7884-4db3-9c6a-64d09f6c6ac4 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1606 microversion: 2.1 time: 0.108625 Sep 01 09:17:26.886051 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 372/757] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:26 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:26.963196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-6260a117-26d7-4e53-969c-8e8e8fed2304 req-ec1bc2c8-347b-4b5c-bbf2-06eae9840645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be4ee16-c20b-4744-9bb7-94a9afbb5415", "name": "network-vif-deleted", "tag": "acaff261-2863-4f8a-85c5-32280f295ab4"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:26.972834 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-6260a117-26d7-4e53-969c-8e8e8fed2304 req-ec1bc2c8-347b-4b5c-bbf2-06eae9840645 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:26.975394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-6260a117-26d7-4e53-969c-8e8e8fed2304 req-ec1bc2c8-347b-4b5c-bbf2-06eae9840645 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:26.975908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-6260a117-26d7-4e53-969c-8e8e8fed2304 req-ec1bc2c8-347b-4b5c-bbf2-06eae9840645 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:26.988570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-6260a117-26d7-4e53-969c-8e8e8fed2304 req-ec1bc2c8-347b-4b5c-bbf2-06eae9840645 service nova] Creating event network-vif-deleted:acaff261-2863-4f8a-85c5-32280f295ab4 for instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 on hv-cinder-82002 Sep 01 09:17:26.999602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-6260a117-26d7-4e53-969c-8e8e8fed2304 req-ec1bc2c8-347b-4b5c-bbf2-06eae9840645 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 Sep 01 09:17:26.999602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 386/758] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:17:27.744183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:27.745056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] [instance: 85c3385c-4154-40a0-bebe-a0f7be2dcc9b] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:27.751974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:27.752498 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:27.753161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:27.753880 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:27.754583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:27.754762 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:27.770045 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] HTTP exception thrown: Instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b could not be found. Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Request method failure captured: Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b HTTP/1.1 Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcF-34v__ijpg5r_L6XoV5szpExUjxYjZ_MYqWfxdNN5WfuYpdM9xtKyFWCpNbusOHbnv5GIpJ2pdzjZmG1BIlWZNBy8R86JFAYOm2wKyA6h4EvpVWQeXCEmDCrJxStgbmuFK4ZabdMnDc5l96OSVESfAH7TbsvMmaFH160n4LRggM Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:17:27.771833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15f1ee0d68f646bcad60cbf31c3c684d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15f1ee0d68f646bcad60cbf31c3c684d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15f1ee0d68f646bcad60cbf31c3c684d"}]}] Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 15f1ee0d68f646bcad60cbf31c3c684d Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-213233879 Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 81816508df7c431fa3b4b495d11ac101 Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-ServerRescueNegativeTestJSON-213233879-project Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b could not be found. Sep 01 09:17:27.774046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '85c3385c-4154-40a0-bebe-a0f7be2dcc9b'} Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b could not be found. Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:27.775209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b could not be found. Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b could not be found. Sep 01 09:17:27.776625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:27.777909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] Returning 404 to user: Instance 85c3385c-4154-40a0-bebe-a0f7be2dcc9b could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:27.777909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-754afa04-faec-4c57-aee9-955777b35f4d tempest-ServerRescueNegativeTestJSON-213233879 tempest-ServerRescueNegativeTestJSON-213233879-project] 10.222.0.46 "GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b" status: 404 len: 111 microversion: 2.1 time: 0.032940 Sep 01 09:17:27.777909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 373/759] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:27 2022] GET /compute/v2.1/servers/85c3385c-4154-40a0-bebe-a0f7be2dcc9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:27.909107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:27.909832 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:27.916273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:27.924124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:27.924124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:27.924124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:27.924124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:27.924556 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:27.952382 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:27.952868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:27.953308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:27.953770 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lazy-loading 'fault' on Instance uuid 8be4ee16-c20b-4744-9bb7-94a9afbb5415 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:17:27.996601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:28.004457 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-70e26355-8c67-40a1-b8bb-063a8820f652 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 200 len: 1327 microversion: 2.1 time: 0.100067 Sep 01 09:17:28.005042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 387/760] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:27 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:29.026453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:29.033616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:29.033953 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:29.034366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:29.034802 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:29.035529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:29.035986 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:29.036412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:29.050351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] HTTP exception thrown: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Request method failure captured: Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 HTTP/1.1 Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcCBu27VgQe9_gyTj0N1W1PaT5h7R_6f3O7vFJ6TXPEfHJnbxnEwmALz4XgjcyB0NiLxbSCc4z_tvAMzFO_dL10csFb6JX1rzmFyb0xbgjAPMzsJx8ItRvYNr4-dZUo0D2wlfic5a3WTY0jdmcBMloqGXcJBz13WCmr3A0foOeuXtc Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:17:29.051885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f5045a17a253414e9c231bcd0d7d24b8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f5045a17a253414e9c231bcd0d7d24b8"}]}] Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 004ab0c0b138457e9a5e9288d039b932 Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:17:29.053429 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '8be4ee16-c20b-4744-9bb7-94a9afbb5415'} Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:29.054495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:17:29.056256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:29.057588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Returning 404 to user: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:29.057588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-60e4794e-4062-4616-90fd-7f47c0c3dc4f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 404 len: 111 microversion: 2.1 time: 0.031369 Sep 01 09:17:29.057588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 374/761] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:29 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:29.062185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9d519242-c4c7-41ac-abd8-89518b55b231 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '.version_select at 0x7f7a653b05e0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:29.164096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9d519242-c4c7-41ac-abd8-89518b55b231 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017900709" status: 202 len: 0 microversion: 2.1 time: 0.104894 Sep 01 09:17:29.171293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 388/762] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Sep 1 09:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017900709 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:17:30.045565 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ef92af53-4c19-4373-9c75-95059538bd22 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'create', calling method: .version_select at 0x7f7a65741040>, body: {"keypair": {"name": "tempest-keypair-247843899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxXK4ZUq5JMB8AXRvXzIDVjJtytYJs6mqD8lMU+Ey1uO5sbCpiSqjpoMbucfexe9kcrpuuwWQn6El4qAbSePkPvTIVO5eWuhGpu6M/krmwCAgjHAE9Zl97V4PHOkbVIaA=="}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:30.062744 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ef92af53-4c19-4373-9c75-95059538bd22 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:17:30.066934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ef92af53-4c19-4373-9c75-95059538bd22 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for user 004ab0c0b138457e9a5e9288d039b932 and project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:17:30.165196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ef92af53-4c19-4373-9c75-95059538bd22 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124019 Sep 01 09:17:30.166119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 375/763] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:17:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:32.605168 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1191638413", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39395f6c-959b-4db4-96d8-3a8b29f2e36f"}], "security_groups": [{"name": "tempest-securitygroup--1345863458"}], "key_name": "tempest-keypair-247843899", "user_data": "}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:32.709596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] validate_networks() for [('39395f6c-959b-4db4-96d8-3a8b29f2e36f', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:17:32.908332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:33.108370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:17:33.108898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:17:33.109448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:17:33.109945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:17:33.110349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:17:33.119842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:33.124121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:33.124121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:33.124121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:33.124121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:33.124485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:33.139808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:17:33.144006 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Getting quotas for user 004ab0c0b138457e9a5e9288d039b932 and project f5045a17a253414e9c231bcd0d7d24b8. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:17:33.156227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:17:33.158555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:17:33.306532 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-01a20ad1-72a1-4ed7-a17f-c3e69ea1a2c1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.706057 Sep 01 09:17:33.307442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 389/764] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:17:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:17:33.319045 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6fbc4028-7f2c-4d8e-a044-e927c9e4c717 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:33.319892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6fbc4028-7f2c-4d8e-a044-e927c9e4c717 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:33.386405 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6fbc4028-7f2c-4d8e-a044-e927c9e4c717 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:33.394321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6fbc4028-7f2c-4d8e-a044-e927c9e4c717 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1237 microversion: 2.1 time: 0.080029 Sep 01 09:17:33.394937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 376/765] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:33 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:33.944528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dae71a23-0aa1-4b0b-8e68-90e3ac71c57f tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Action: 'create', calling method: .version_select at 0x7f7a653b0160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-657766832"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:34.415887 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:34.417081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:34.423802 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:34.424682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:34.425133 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:34.425829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:34.426281 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:34.426747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:34.489308 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:34.498182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5d90762b-f58d-42fd-a4cf-b91547d7c12c tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1241 microversion: 2.1 time: 0.086361 Sep 01 09:17:34.498765 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 377/766] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:34 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:17:34.625698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dae71a23-0aa1-4b0b-8e68-90e3ac71c57f tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.800234 Sep 01 09:17:34.626336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 390/767] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Sep 1 09:17:33 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 802 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 09:17:34.639598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d5f9b735-4946-48c4-a3fb-32fc6e5be248 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a654434c0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:34.692462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d5f9b735-4946-48c4-a3fb-32fc6e5be248 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134" status: 200 len: 344 microversion: 2.1 time: 0.056848 Sep 01 09:17:34.693247 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 378/768] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:17:34 2022] GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:35.519847 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:35.520464 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:35.527583 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:35.528071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:35.528507 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:35.529187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:35.529773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:35.530199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:35.601406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:35.609537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d9e4b896-e879-4f0c-a74b-7f900f65e5d1 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1289 microversion: 2.1 time: 0.094065 Sep 01 09:17:35.610201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 391/769] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:35 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:35.707031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-32cacc7f-1e8a-4239-9161-3f20f1f57cbc tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a651a7af0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:35.758151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-32cacc7f-1e8a-4239-9161-3f20f1f57cbc tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134" status: 200 len: 345 microversion: 2.1 time: 0.055384 Sep 01 09:17:35.758738 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 379/770] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:17:35 2022] GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:35.771047 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5496c8aa-22b8-416b-a47f-df8530b995a2 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Action: 'create', calling method: .version_select at 0x7f7a654a4ca0>, body: {"snapshot": {"volume_id": "c4c6072f-0686-42f3-a939-c7c78a68f134", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1245258555"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:36.186166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5496c8aa-22b8-416b-a47f-df8530b995a2 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.419012 Sep 01 09:17:36.186802 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 392/771] 10.222.0.46 () {60 vars in 1162 bytes} [Thu Sep 1 09:17:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:36.198221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aaaff681-4414-401b-8754-1692c377a24c tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a6541dc10>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:36.228088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-aaaff681-4414-401b-8754-1692c377a24c tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 287 microversion: 2.1 time: 0.034520 Sep 01 09:17:36.232850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 380/772] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:36 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:17:36.239328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-92e39ac6-c517-4748-a019-1d0a36b77813 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a654d0700>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:36.271086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-92e39ac6-c517-4748-a019-1d0a36b77813 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035773 Sep 01 09:17:36.271705 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 393/773] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Sep 1 09:17:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:36.282983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2f9c7970-5c59-4d7f-bc57-6a8b9dc12d4d tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a6528bdc0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:36.314921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2f9c7970-5c59-4d7f-bc57-6a8b9dc12d4d tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 287 microversion: 2.1 time: 0.035666 Sep 01 09:17:36.315519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 381/774] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:36 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:36.634021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:36.635275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:36.642194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:36.645046 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:36.645046 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:36.645046 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:36.645046 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:36.645460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:36.777536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:36.785480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2d4eadb5-7060-4eb5-a23c-388a59975785 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.155891 Sep 01 09:17:36.786218 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 394/775] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:36 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:37.291547 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-88493209-dc66-4259-a774-d915a7cac872 req-65c24d4b-47e7-4c4e-b398-f3f8ade4aa1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6c0528-b9b4-44c3-860b-ab406b4c9d51", "tag": "53fe1be0-1913-4628-9671-66a140324e18"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:37.300794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-88493209-dc66-4259-a774-d915a7cac872 req-65c24d4b-47e7-4c4e-b398-f3f8ade4aa1a service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:37.301269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-88493209-dc66-4259-a774-d915a7cac872 req-65c24d4b-47e7-4c4e-b398-f3f8ade4aa1a service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:37.301700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-88493209-dc66-4259-a774-d915a7cac872 req-65c24d4b-47e7-4c4e-b398-f3f8ade4aa1a service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:37.313166 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-88493209-dc66-4259-a774-d915a7cac872 req-65c24d4b-47e7-4c4e-b398-f3f8ade4aa1a service nova] Creating event network-changed:53fe1be0-1913-4628-9671-66a140324e18 for instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 on hv-cinder-82002 Sep 01 09:17:37.318168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-88493209-dc66-4259-a774-d915a7cac872 req-65c24d4b-47e7-4c4e-b398-f3f8ade4aa1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031642 Sep 01 09:17:37.319148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 382/776] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:37.327987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cdd52fca-12f6-4b5c-9699-acd4f266d6d2 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a654d00d0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:37.358357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cdd52fca-12f6-4b5c-9699-acd4f266d6d2 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 287 microversion: 2.1 time: 0.034184 Sep 01 09:17:37.358933 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 395/777] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:37 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:37.808075 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:37.808700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:37.814764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:37.815283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:37.815723 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:37.816407 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:37.816894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:37.817321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:37.945000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:37.952553 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-03a8bd1d-0094-45e1-b50a-e506383658dc tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.148819 Sep 01 09:17:37.953127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 383/778] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:37 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:38.371907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7d44777b-d38a-404e-ae3b-62c18b1e7877 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a654a4ca0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:38.401986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7d44777b-d38a-404e-ae3b-62c18b1e7877 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 287 microversion: 2.1 time: 0.034666 Sep 01 09:17:38.402546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 396/779] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:38 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:38.973825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:38.974486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:38.981077 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:38.981618 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:38.982056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:38.982735 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:38.983212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:38.983632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:39.113275 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:39.121561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dfcc69e2-a829-46ed-8ee3-a8a4f728d4e0 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.151754 Sep 01 09:17:39.122130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 384/780] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:38 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:39.415590 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b1263894-1347-43a6-bd21-d6eb27d8fa5a tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a65651550>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:39.445783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b1263894-1347-43a6-bd21-d6eb27d8fa5a tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 287 microversion: 2.1 time: 0.035158 Sep 01 09:17:39.446351 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 397/781] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:39 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:40.141952 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:40.142575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:40.149712 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:40.150202 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:40.160185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:40.160185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:40.160185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:40.160185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:40.280408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:40.288175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9589e73f-3a07-40ab-bd2a-fa1f62db6290 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.150114 Sep 01 09:17:40.288776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 385/782] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:40 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:40.459819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9df2a9eb-2aa9-4db3-b1f3-6295703e4dff tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a654c9ca0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:40.489332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9df2a9eb-2aa9-4db3-b1f3-6295703e4dff tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 287 microversion: 2.1 time: 0.034654 Sep 01 09:17:40.489927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 398/783] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:40 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:41.309024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:41.309589 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:41.315905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:41.316385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:41.316814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:41.317496 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:41.318044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:41.319089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:41.464988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:41.472773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ddbc7c16-9d31-47ca-8bcd-33bdb2821033 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.167710 Sep 01 09:17:41.473359 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 386/784] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:41 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:41.502982 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e250067b-aaf5-4768-9408-b0f8294631e6 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a654740d0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:41.533102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e250067b-aaf5-4768-9408-b0f8294631e6 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 288 microversion: 2.1 time: 0.034512 Sep 01 09:17:41.533698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 399/785] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:41 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:41.544776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5aeb877d-2113-49bd-8e28-1bbbfa549889 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a6514e310>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:41.646450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5aeb877d-2113-49bd-8e28-1bbbfa549889 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 202 len: 0 microversion: 2.1 time: 0.105246 Sep 01 09:17:41.647352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 387/786] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Sep 1 09:17:41 2022] DELETE /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:17:41.656254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2c6edd9e-f34d-4ac6-ba54-dc168c1fe838 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a653b0ca0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:41.687339 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2c6edd9e-f34d-4ac6-ba54-dc168c1fe838 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 200 len: 287 microversion: 2.1 time: 0.035511 Sep 01 09:17:41.687903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 400/787] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:41 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:42.494255 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:42.494871 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:42.500902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:42.501391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:42.501834 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:42.502523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:42.502983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:42.503444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:42.634548 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:42.642131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c8f1cdb8-8f81-4ff6-afa6-9fb5438704d6 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.152659 Sep 01 09:17:42.642733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 388/788] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:42 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:42.701618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-79965f79-b373-4c32-a35f-2ccfb526a3c0 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a65474820>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:42.726307 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-79965f79-b373-4c32-a35f-2ccfb526a3c0 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] HTTP exception thrown: Snapshot 018715c4-c4be-4c09-a855-3d8fad271f2f could not be found. Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-79965f79-b373-4c32-a35f-2ccfb526a3c0 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Request method failure captured: Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f HTTP/1.1 Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHitFnWeAo8_83pu2gNLSaquUriYIr71pG5vTuUcGrFSjqcI1pLqpzRSb3-_YuNsTvTPElVQ7pHP2rPc02rgl-l1wsnu3ZHtf7ieeRPCwiwXUmwTpMRWoCnLEByonD8EjL-Z14CuEEGow37hWtiRpWUIonfXjgKohQHqx9tZwor06Xs Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:17:42.729653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_feeebade381c4f288e48ad8ebf94084f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/feeebade381c4f288e48ad8ebf94084f"}]}] Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: d89cd06dd6924910a9d8b56731cfb368 Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Snapshot 018715c4-c4be-4c09-a855-3d8fad271f2f could not be found. Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '018715c4-c4be-4c09-a855-3d8fad271f2f'} Sep 01 09:17:42.731297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 018715c4-c4be-4c09-a855-3d8fad271f2f could not be found. (HTTP 404) (Request-ID: req-5b0afaf1-d920-4764-8fa2-3400d279dbe9) Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:42.732173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:17:42.733361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 018715c4-c4be-4c09-a855-3d8fad271f2f could not be found. Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 09:17:42.734504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 018715c4-c4be-4c09-a855-3d8fad271f2f could not be found. Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 018715c4-c4be-4c09-a855-3d8fad271f2f could not be found. Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-79965f79-b373-4c32-a35f-2ccfb526a3c0 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Returning 404 to user: Snapshot 018715c4-c4be-4c09-a855-3d8fad271f2f could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:42.736171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-79965f79-b373-4c32-a35f-2ccfb526a3c0 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f" status: 404 len: 111 microversion: 2.1 time: 0.033822 Sep 01 09:17:42.737110 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 401/789] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Sep 1 09:17:42 2022] GET /compute/v2.1/os-snapshots/018715c4-c4be-4c09-a855-3d8fad271f2f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:42.739691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7437a509-6b83-4e95-8676-605aa9f82621 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a6516d670>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:42.918973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7437a509-6b83-4e95-8676-605aa9f82621 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134" status: 202 len: 0 microversion: 2.1 time: 0.182945 Sep 01 09:17:42.919605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 389/790] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:17:42 2022] DELETE /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 09:17:42.927793 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5229161a-6cc0-4cb2-922b-5d2e3fd79f08 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a656b3820>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:42.975155 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5229161a-6cc0-4cb2-922b-5d2e3fd79f08 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134" status: 200 len: 344 microversion: 2.1 time: 0.051068 Sep 01 09:17:42.975799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 402/791] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:17:42 2022] GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:43.660776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:43.665877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:43.666494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:43.672409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:43.672984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:43.673424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:43.674114 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:43.674575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:43.675000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:43.951724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:43.959244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-be3f8d3a-2933-4ad0-855d-732211dde011 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.299268 Sep 01 09:17:43.960417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 390/792] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:43 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:43.985802 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:43.986565 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:17:43.990731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b3f91b9a-a1be-4f2b-b1b3-e4aa232b1031 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a65474ca0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:44.018771 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-b3f91b9a-a1be-4f2b-b1b3-e4aa232b1031 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] HTTP exception thrown: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b3f91b9a-a1be-4f2b-b1b3-e4aa232b1031 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Request method failure captured: Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 HTTP/1.1 Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHitFnWeAo8_83pu2gNLSaquUriYIr71pG5vTuUcGrFSjqcI1pLqpzRSb3-_YuNsTvTPElVQ7pHP2rPc02rgl-l1wsnu3ZHtf7ieeRPCwiwXUmwTpMRWoCnLEByonD8EjL-Z14CuEEGow37hWtiRpWUIonfXjgKohQHqx9tZwor06Xs Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:17:44.021090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_feeebade381c4f288e48ad8ebf94084f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/feeebade381c4f288e48ad8ebf94084f"}]}] Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: d89cd06dd6924910a9d8b56731cfb368 Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'c4c6072f-0686-42f3-a939-c7c78a68f134'} Sep 01 09:17:44.023242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. (HTTP 404) (Request-ID: req-a298ea96-047e-4277-950c-b6903f29d3ab) Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.024198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:17:44.025748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 09:17:44.027566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b3f91b9a-a1be-4f2b-b1b3-e4aa232b1031 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Returning 404 to user: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b3f91b9a-a1be-4f2b-b1b3-e4aa232b1031 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134" status: 404 len: 109 microversion: 2.1 time: 0.037388 Sep 01 09:17:44.028967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 403/793] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:17:43 2022] GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:44.036961 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-90f7ca8a-7a00-44eb-b682-60f3d22ce927 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a65853550>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:44.064668 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-90f7ca8a-7a00-44eb-b682-60f3d22ce927 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] HTTP exception thrown: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-90f7ca8a-7a00-44eb-b682-60f3d22ce927 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Request method failure captured: Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 HTTP/1.1 Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHitFnWeAo8_83pu2gNLSaquUriYIr71pG5vTuUcGrFSjqcI1pLqpzRSb3-_YuNsTvTPElVQ7pHP2rPc02rgl-l1wsnu3ZHtf7ieeRPCwiwXUmwTpMRWoCnLEByonD8EjL-Z14CuEEGow37hWtiRpWUIonfXjgKohQHqx9tZwor06Xs Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:17:44.065977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_feeebade381c4f288e48ad8ebf94084f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/feeebade381c4f288e48ad8ebf94084f"}]}] Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: d89cd06dd6924910a9d8b56731cfb368 Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'c4c6072f-0686-42f3-a939-c7c78a68f134'} Sep 01 09:17:44.067597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. (HTTP 404) (Request-ID: req-8862f631-dcba-4b5a-b9bb-2bfa84abf3a8) Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.068691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 09:17:44.070597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 09:17:44.072095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-90f7ca8a-7a00-44eb-b682-60f3d22ce927 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Returning 404 to user: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-90f7ca8a-7a00-44eb-b682-60f3d22ce927 tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134" status: 404 len: 109 microversion: 2.1 time: 0.034176 Sep 01 09:17:44.073435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 391/794] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:17:44 2022] DELETE /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:44.076679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b5215745-e22e-4b16-a0ca-04bd8f98cbee tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Calling method '.version_select at 0x7f7a653c7790>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:44.105366 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-b5215745-e22e-4b16-a0ca-04bd8f98cbee tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] HTTP exception thrown: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b5215745-e22e-4b16-a0ca-04bd8f98cbee tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Request method failure captured: Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 HTTP/1.1 Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHitFnWeAo8_83pu2gNLSaquUriYIr71pG5vTuUcGrFSjqcI1pLqpzRSb3-_YuNsTvTPElVQ7pHP2rPc02rgl-l1wsnu3ZHtf7ieeRPCwiwXUmwTpMRWoCnLEByonD8EjL-Z14CuEEGow37hWtiRpWUIonfXjgKohQHqx9tZwor06Xs Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:17:44.107328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_feeebade381c4f288e48ad8ebf94084f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/feeebade381c4f288e48ad8ebf94084f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/feeebade381c4f288e48ad8ebf94084f"}]}] Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: feeebade381c4f288e48ad8ebf94084f Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1278085571 Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: d89cd06dd6924910a9d8b56731cfb368 Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1278085571-project Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'c4c6072f-0686-42f3-a939-c7c78a68f134'} Sep 01 09:17:44.108781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. (HTTP 404) (Request-ID: req-9d23adb5-4322-471f-bfd0-3e1e91a14b25) Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.109752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:17:44.111178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 09:17:44.112637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b5215745-e22e-4b16-a0ca-04bd8f98cbee tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] Returning 404 to user: Volume c4c6072f-0686-42f3-a939-c7c78a68f134 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b5215745-e22e-4b16-a0ca-04bd8f98cbee tempest-VolumesSnapshotsTestJSON-1278085571 tempest-VolumesSnapshotsTestJSON-1278085571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134" status: 404 len: 109 microversion: 2.1 time: 0.036233 Sep 01 09:17:44.113945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 404/795] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:17:44 2022] GET /compute/v2.1/os-volumes/c4c6072f-0686-42f3-a939-c7c78a68f134 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:17:44.981626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:44.982397 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:44.989070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:44.989568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:44.990015 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:44.990725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:44.991297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:44.992008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:45.128939 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:45.136595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6f8f6805-86b0-49b7-8729-c8513aef26bd tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.159302 Sep 01 09:17:45.137166 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 392/796] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:44 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:46.158418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:46.159042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:46.165512 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:46.166011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:46.166456 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:46.167227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:46.167695 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:46.168128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:46.304447 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:46.312008 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d7b39f18-641c-4ded-ac0e-ec07735b9681 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.158030 Sep 01 09:17:46.312575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 405/797] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:46 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:46.814363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-5cda2c6b-60da-4e66-90e8-2314961e32ea req-0d8068e5-afa2-4fdd-82ba-195a95367e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6c0528-b9b4-44c3-860b-ab406b4c9d51", "name": "network-vif-plugged", "status": "completed", "tag": "53fe1be0-1913-4628-9671-66a140324e18"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:46.826053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-5cda2c6b-60da-4e66-90e8-2314961e32ea req-0d8068e5-afa2-4fdd-82ba-195a95367e30 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:46.828415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-5cda2c6b-60da-4e66-90e8-2314961e32ea req-0d8068e5-afa2-4fdd-82ba-195a95367e30 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:46.828415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-5cda2c6b-60da-4e66-90e8-2314961e32ea req-0d8068e5-afa2-4fdd-82ba-195a95367e30 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:46.838058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-5cda2c6b-60da-4e66-90e8-2314961e32ea req-0d8068e5-afa2-4fdd-82ba-195a95367e30 service nova] Creating event network-vif-plugged:53fe1be0-1913-4628-9671-66a140324e18 for instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 on hv-cinder-82002 Sep 01 09:17:46.843084 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-5cda2c6b-60da-4e66-90e8-2314961e32ea req-0d8068e5-afa2-4fdd-82ba-195a95367e30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033581 Sep 01 09:17:46.843755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 393/798] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:47.333321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:47.333930 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:47.340773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:47.341248 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:47.341679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:47.342363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:47.342811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:47.343352 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:47.470784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:47.479227 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ede14b02-1b2e-4628-9814-232e2d7803c7 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.149887 Sep 01 09:17:47.479841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 406/799] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:47 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:48.501572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:48.502278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:48.508597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:48.509083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:48.509523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:48.510214 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:48.510674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:48.511122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:48.638780 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:48.646523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-565785a2-5193-4397-ae26-b8be996ab98d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1363 microversion: 2.1 time: 0.150258 Sep 01 09:17:48.647206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 394/800] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:48 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:49.667710 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:49.668322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:49.675630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:49.676133 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:49.676768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:49.678031 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:49.678498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:49.678995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:49.814327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:17:49.822660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e2eca8f0-babe-4a60-88f7-89b2f6ddba54 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1548 microversion: 2.1 time: 0.159154 Sep 01 09:17:49.823249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 407/801] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:17:49 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:17:49.842910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:17:49.843449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:17:49.849594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:49.850079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:49.850513 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:49.851220 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:49.851676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:49.852094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:49.928074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-84835ef5-5561-4330-ac29-180f514ffc79 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088987 Sep 01 09:17:49.928664 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 395/802] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:17:49 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:17:50.908818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-5aef0c22-cf40-42be-a96f-3355340fc4d6 req-6a8074bf-ed56-47bf-8cdd-5eda8623e3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6c0528-b9b4-44c3-860b-ab406b4c9d51", "tag": "53fe1be0-1913-4628-9671-66a140324e18"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:17:50.919222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-5aef0c22-cf40-42be-a96f-3355340fc4d6 req-6a8074bf-ed56-47bf-8cdd-5eda8623e3d3 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:17:50.919706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-5aef0c22-cf40-42be-a96f-3355340fc4d6 req-6a8074bf-ed56-47bf-8cdd-5eda8623e3d3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:17:50.920136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-5aef0c22-cf40-42be-a96f-3355340fc4d6 req-6a8074bf-ed56-47bf-8cdd-5eda8623e3d3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:17:50.931457 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-5aef0c22-cf40-42be-a96f-3355340fc4d6 req-6a8074bf-ed56-47bf-8cdd-5eda8623e3d3 service nova] Creating event network-changed:53fe1be0-1913-4628-9671-66a140324e18 for instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 on hv-cinder-82002 Sep 01 09:17:50.936437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-5aef0c22-cf40-42be-a96f-3355340fc4d6 req-6a8074bf-ed56-47bf-8cdd-5eda8623e3d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031237 Sep 01 09:17:50.937092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 408/803] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:07.323549 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:07.324297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=77 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:07.328120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:07.328608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:07.334338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:07.334819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:07.335294 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:07.336531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:07.336531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:07.336811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:07.361803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-42346c41-b06c-434c-87c1-26b87b9cc0b1 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/ips" status: 200 len: 150 microversion: 2.1 time: 0.039806 Sep 01 09:18:07.362350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 396/804] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:18:07 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:09.972132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:09.972982 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:09.978212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "034ea289-6e4e-4ad3-a981-32a786f0daa0"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:09.980804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:09.986771 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:09.987537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:09.987968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:09.988650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:09.989102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:09.989552 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:10.895640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a073173a-8265-45aa-96e9-79b2d55785ce tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924702 Sep 01 09:18:10.896903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 409/805] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:18:09 2022] POST /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:19.476876 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "034ea289-6e4e-4ad3-a981-32a786f0daa0"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:19.480633 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:19.486176 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:19.486664 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:19.487144 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:19.487840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:19.488300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:19.488732 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:19.570051 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Invalid volume: volume 034ea289-6e4e-4ad3-a981-32a786f0daa0 is already attached to instances: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: POST /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments HTTP/1.1 Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 74 Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:18:19.577224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {"volumeAttachment": {"volumeId": "034ea289-6e4e-4ad3-a981-32a786f0daa0"}} Sep 01 09:18:19.579370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Invalid volume: volume 034ea289-6e4e-4ad3-a981-32a786f0daa0 is already attached to instances: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'server_id': 'c73bc5ef-57fb-47a3-844d-b8a0f88c4c12', 'body': {'volumeAttachment': {'volumeId': '034ea289-6e4e-4ad3-a981-32a786f0daa0'}}} Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 034ea289-6e4e-4ad3-a981-32a786f0daa0 is already attached to instances: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:19.580272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 034ea289-6e4e-4ad3-a981-32a786f0daa0 is already attached to instances: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:19.582323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 034ea289-6e4e-4ad3-a981-32a786f0daa0 is already attached to instances: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 400 to user: Invalid volume: volume 034ea289-6e4e-4ad3-a981-32a786f0daa0 is already attached to instances: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-aef3e956-d4c7-40de-8054-68763211e113 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101238 Sep 01 09:18:19.584492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 397/806] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:18:19 2022] POST /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:18:19.638489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:19.639072 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:19.645442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:19.645985 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:19.646702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:19.647500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:19.647963 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:19.648492 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:19.732679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'services' on Instance uuid c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:19.933718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5254e33e-7dd6-415c-9f00-36f0ce15fbad tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments/034ea289-6e4e-4ad3-a981-32a786f0daa0" status: 202 len: 0 microversion: 2.1 time: 0.296719 Sep 01 09:18:19.933718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 410/807] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:18:19 2022] DELETE /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments/034ea289-6e4e-4ad3-a981-32a786f0daa0 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:18:19.939956 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:19.942096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:19.948275 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:19.948766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:19.949206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:19.949908 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:19.950363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:19.950988 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:19.981655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-779dfda8-acfe-4fc4-a2be-f4221fc59733 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Sep 01 09:18:19.982213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 398/808] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:18:19 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:20.994716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:20.996994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:21.003775 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:21.004267 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:21.004706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:21.005502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:21.005968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:21.006396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:21.037997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-354c5ae9-344b-461a-8a60-ec8884358f8b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Sep 01 09:18:21.044629 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 411/809] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:18:20 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:22.054223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:22.055659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:22.062221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:22.062706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:22.063161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:22.063858 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:22.064326 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:22.064730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:22.093351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-56285e77-e2de-4db8-9134-9b06934bbeef tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044948 Sep 01 09:18:22.093909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 399/810] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:18:22 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:18:22.156202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:22.156704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:22.163785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:22.164269 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:22.164706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:22.165404 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:22.165858 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:22.166317 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:22.192766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:18:22.467325 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-45fb6bb9-6999-42fd-a6ef-1db8d754e473 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 204 len: 0 microversion: 2.1 time: 0.314610 Sep 01 09:18:22.467922 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 412/811] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:18:22 2022] DELETE /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:18:22.476515 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:22.477126 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:22.483088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:22.483597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:22.484029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:22.484715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:22.485165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:22.485836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:22.628964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:22.636797 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1a2f5f53-1751-4c4e-a236-85ebc4dade7c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1681 microversion: 2.1 time: 0.164701 Sep 01 09:18:22.637369 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 400/812] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:22 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:23.658448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:23.659166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:23.665987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:23.666451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:23.666885 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:23.667628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:23.668082 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:23.668509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:23.800481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:23.808713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e417eaf5-afd9-4d7b-ace7-df5932d7f09b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1681 microversion: 2.1 time: 0.154577 Sep 01 09:18:23.809278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 413/813] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:23 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:24.830199 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:24.830884 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:24.837746 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:24.838891 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:24.839443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:24.840480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:24.841003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:24.841441 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:24.990848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:24.999082 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-280ad1fd-152b-4234-bfbc-3d7297f10dc2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1681 microversion: 2.1 time: 0.173016 Sep 01 09:18:24.999691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 401/814] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:24 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:25.813996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-c69e055e-39f7-45a3-9937-f34b64e36823 req-088901ad-f1c9-4de6-b9af-67e6efdd375e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73bc5ef-57fb-47a3-844d-b8a0f88c4c12", "name": "network-vif-deleted", "tag": "5782f04f-9081-48a1-8077-fa5e3c9f2115"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:25.834482 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-c69e055e-39f7-45a3-9937-f34b64e36823 req-088901ad-f1c9-4de6-b9af-67e6efdd375e service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:25.834984 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-c69e055e-39f7-45a3-9937-f34b64e36823 req-088901ad-f1c9-4de6-b9af-67e6efdd375e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:25.838813 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-c69e055e-39f7-45a3-9937-f34b64e36823 req-088901ad-f1c9-4de6-b9af-67e6efdd375e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:25.853130 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-c69e055e-39f7-45a3-9937-f34b64e36823 req-088901ad-f1c9-4de6-b9af-67e6efdd375e service nova] Creating event network-vif-deleted:5782f04f-9081-48a1-8077-fa5e3c9f2115 for instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 on hv-cinder-82002 Sep 01 09:18:25.858132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-c69e055e-39f7-45a3-9937-f34b64e36823 req-088901ad-f1c9-4de6-b9af-67e6efdd375e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050887 Sep 01 09:18:25.858758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 414/815] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:26.022928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:26.023658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:26.031519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:26.032172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:26.032716 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:26.033533 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:26.034103 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:26.034640 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:26.127259 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:26.135890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-27b921a6-81be-4fc6-855a-20aa5d74d589 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1325 microversion: 2.1 time: 0.117515 Sep 01 09:18:26.136706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 402/816] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:26 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1325 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:27.159409 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:27.160137 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:27.167271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:27.167825 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:27.168265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:27.168951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:27.169412 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:27.169839 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:27.201042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:27.201461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:27.201899 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:27.202344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'fault' on Instance uuid c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:27.247605 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:27.255891 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-12c70c2c-ae26-4ba8-a0dd-5546c4d5b134 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1330 microversion: 2.1 time: 0.101106 Sep 01 09:18:27.256455 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 415/817] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:27 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:28.276102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:28.276641 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:28.282980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:28.283491 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:28.283924 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:28.284607 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:28.285056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:28.286075 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:28.316703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:28.317271 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:28.317709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:28.318153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'fault' on Instance uuid c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:28.360392 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:28.367260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-340d1a0e-a139-487d-8f9c-885940c7abc4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1330 microversion: 2.1 time: 0.095058 Sep 01 09:18:28.367831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 403/818] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:28 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:29.388087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:29.388610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:29.395363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:29.395854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:29.396324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:29.397049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:29.397509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:29.397937 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:29.428414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:29.428898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:29.429336 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:29.429781 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'fault' on Instance uuid c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:29.469205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:29.477480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c17d18ed-1f02-435c-a28a-bb5e03d9fd6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 200 len: 1330 microversion: 2.1 time: 0.093296 Sep 01 09:18:29.478051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 416/819] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:29 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:30.499379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:30.499981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:30.507165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:30.509144 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:30.509144 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:30.509144 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:30.509445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:30.509592 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:30.525115 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 HTTP/1.1 Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:18:30.526652 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:18:30.528382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'c73bc5ef-57fb-47a3-844d-b8a0f88c4c12'} Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:18:30.529446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:18:30.530982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:18:30.532544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:18:30.532544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-deaca4b2-8d9b-4158-97fa-2065a310041f tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 404 len: 111 microversion: 2.1 time: 0.032752 Sep 01 09:18:30.532544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 404/820] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:30 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 09:18:30.537087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6c8f9836-cd8a-4959-81f4-fb5acd73c477 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '.version_select at 0x7f7a653c7dc0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:30.632926 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6c8f9836-cd8a-4959-81f4-fb5acd73c477 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101262563" status: 202 len: 0 microversion: 2.1 time: 0.099775 Sep 01 09:18:30.633524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 417/821] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 09:18:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101262563 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:18:31.361310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6143b2ed-fe1e-4ba3-b2ec-4d5d5db35bf4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: .version_select at 0x7f7a6514e4c0>, body: {"keypair": {"name": "tempest-keypair-2083225409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyWb3sk30ATik76Q91fgAU5V/1/TzTzcVA1aycn2N3z8w0jWYGvRl3UB/shb1H0MvOsbToEtiWH7ZDQ6iXRJcphGMntA/JA52pR6cNDcUjnxkfbPNF4lU6qxn5oAPn20g=="}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:31.377711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-6143b2ed-fe1e-4ba3-b2ec-4d5d5db35bf4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:18:31.381457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-6143b2ed-fe1e-4ba3-b2ec-4d5d5db35bf4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'key_pairs'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:18:31.461810 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6143b2ed-fe1e-4ba3-b2ec-4d5d5db35bf4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105035 Sep 01 09:18:31.462413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 405/822] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:18:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:31.811249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-892003970"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:31.811916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:31.827365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:31.827861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:31.828303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:31.829009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:31.829495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:31.830106 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:31.962500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.network.security_group_api [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Removing security group 1182e2c0-76da-456d-afd0-e33727cb515e from port 59adb5de-03d0-4adf-8b66-fa4fd1d06955 Sep 01 09:18:32.406022 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-021c6727-7299-4261-9f67-00edfb87238e tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.599292 Sep 01 09:18:32.406789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 418/823] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:18:31 2022] POST /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:18:32.415125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-36f3c2bc-a78e-485e-aaea-49294d434d9c req-e9ad30a5-e70b-49e9-bc50-ee1bd7760e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77faab74-d45f-43e0-98a0-047afa7f4ab1", "tag": "59adb5de-03d0-4adf-8b66-fa4fd1d06955"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:32.425661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-36f3c2bc-a78e-485e-aaea-49294d434d9c req-e9ad30a5-e70b-49e9-bc50-ee1bd7760e15 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:32.426555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-36f3c2bc-a78e-485e-aaea-49294d434d9c req-e9ad30a5-e70b-49e9-bc50-ee1bd7760e15 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:32.426740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-36f3c2bc-a78e-485e-aaea-49294d434d9c req-e9ad30a5-e70b-49e9-bc50-ee1bd7760e15 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:32.439782 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-36f3c2bc-a78e-485e-aaea-49294d434d9c req-e9ad30a5-e70b-49e9-bc50-ee1bd7760e15 service nova] Creating event network-changed:59adb5de-03d0-4adf-8b66-fa4fd1d06955 for instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 on hv-cinder-82002 Sep 01 09:18:32.447027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-36f3c2bc-a78e-485e-aaea-49294d434d9c req-e9ad30a5-e70b-49e9-bc50-ee1bd7760e15 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035920 Sep 01 09:18:32.447726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 406/824] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:18:33.871186 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:33.872343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:33.879886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:33.880374 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:33.880993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:33.881701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:33.882156 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:33.882583 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:33.934573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-731226908", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d95d47db-eb5b-4df8-8295-e8765bcebf85"}], "security_groups": [{"name": "tempest-securitygroup--486074719"}], "key_name": "tempest-keypair-2083225409", "user_data": "}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:33.968970 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lazy-loading 'services' on Instance uuid 77faab74-d45f-43e0-98a0-047afa7f4ab1 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:34.056883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] validate_networks() for [('d95d47db-eb5b-4df8-8295-e8765bcebf85', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:18:34.185249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8bbdc124-66cc-46a7-8e0b-aefdb28affe3 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "DELETE /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments/d1b2dcdf-483f-407f-af33-1a757127e1ee" status: 202 len: 0 microversion: 2.1 time: 0.318085 Sep 01 09:18:34.189871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 419/825] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:18:33 2022] DELETE /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments/d1b2dcdf-483f-407f-af33-1a757127e1ee => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:18:34.194660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:34.197332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:34.204438 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:34.205196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:34.205631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:34.207399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:34.208329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:34.209240 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:34.245019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-63c2e1a1-ca90-4dd5-86f6-a68a236ac1af tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054726 Sep 01 09:18:34.246874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 420/826] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:18:34 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:34.466757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-3f4d8544-b586-4b55-bd6b-70f644aac5a3 req-0733ebf2-8e08-4e25-b598-e6a8e2beac0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77faab74-d45f-43e0-98a0-047afa7f4ab1", "tag": "59adb5de-03d0-4adf-8b66-fa4fd1d06955"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:34.477014 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3f4d8544-b586-4b55-bd6b-70f644aac5a3 req-0733ebf2-8e08-4e25-b598-e6a8e2beac0d service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:34.477737 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3f4d8544-b586-4b55-bd6b-70f644aac5a3 req-0733ebf2-8e08-4e25-b598-e6a8e2beac0d service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:34.478710 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-3f4d8544-b586-4b55-bd6b-70f644aac5a3 req-0733ebf2-8e08-4e25-b598-e6a8e2beac0d service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:34.492651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-3f4d8544-b586-4b55-bd6b-70f644aac5a3 req-0733ebf2-8e08-4e25-b598-e6a8e2beac0d service nova] Creating event network-changed:59adb5de-03d0-4adf-8b66-fa4fd1d06955 for instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 on hv-cinder-82002 Sep 01 09:18:34.498637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-3f4d8544-b586-4b55-bd6b-70f644aac5a3 req-0733ebf2-8e08-4e25-b598-e6a8e2beac0d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035617 Sep 01 09:18:34.499783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 421/827] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:18:34.594360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:18:34.594724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:18:34.595252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:18:34.595664 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:18:34.596257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:18:34.606223 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:34.608819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:34.608819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:34.608819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:34.608819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:34.609196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:34.627164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:18:34.632347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Getting quotas for user 02240dc931e140498d82c6d91efb60c8 and project c1035740bd454149963828f12066b70d. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:18:34.644974 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:18:34.647464 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:18:34.754120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4530b651-14b4-400a-9300-6e2b1122d3fb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.823522 Sep 01 09:18:34.755081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 407/828] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:18:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:18:34.766958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5812da16-ee6c-4418-9b60-c3ac9151f414 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:34.767787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5812da16-ee6c-4418-9b60-c3ac9151f414 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:34.853962 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5812da16-ee6c-4418-9b60-c3ac9151f414 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:34.867480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5812da16-ee6c-4418-9b60-c3ac9151f414 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1241 microversion: 2.1 time: 0.100124 Sep 01 09:18:34.868471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 422/829] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:34 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:35.260807 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:35.263166 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:35.271701 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:35.272198 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:35.272647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:35.273561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:35.274138 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:35.274494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:35.306049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5274fe42-0d91-46d9-adbf-197f32f28f0f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051131 Sep 01 09:18:35.306629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 408/830] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:18:35 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:35.888464 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:35.889081 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:35.896606 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:35.897101 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:35.897536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:35.898233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:35.898684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:35.899315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:35.962833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:35.970468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a49e1f4f-9c63-484e-945d-2ddb023bfb99 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1245 microversion: 2.1 time: 0.086018 Sep 01 09:18:35.971079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 423/831] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:35 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:36.318991 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:36.321228 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:36.328018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:36.328506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:36.328944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:36.329639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:36.330096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:36.330523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:36.364359 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d91b7aef-33e4-42d3-ade2-7459baafa780 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050367 Sep 01 09:18:36.365152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 409/832] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:18:36 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:18:36.377262 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:36.378306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:36.384093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:36.384573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:36.385023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:36.385689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:36.386135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:36.386552 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:36.390697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:36.462773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] HTTP exception thrown: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 is not attached to volume d1b2dcdf-483f-407f-af33-1a757127e1ee Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Request method failure captured: Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: DELETE /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments/d1b2dcdf-483f-407f-af33-1a757127e1ee HTTP/1.1 Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHf3_a58Cq0mxPxzImTjrvrEMHHrgB7esyKQwhfOYfasElYdyeh8HY4kLXElw-V1MeXsfIToKDhetTuw00BsyNmqF5q3mGrsIF2NCWesfDx6rD_GrndBnlTPAHf34BApiOlqzzDuoBvk3B8IBKWCCpJo2dr0eiX7YCKi1fbFxprwkyo Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 14201dd9cdf946d2824c31e55c0573f8 Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-TestMinimumBasicScenario-3322305 Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:18:36.465144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/14201dd9cdf946d2824c31e55c0573f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_14201dd9cdf946d2824c31e55c0573f8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/14201dd9cdf946d2824c31e55c0573f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/14201dd9cdf946d2824c31e55c0573f8"}]}] Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-TestMinimumBasicScenario-3322305 Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 14201dd9cdf946d2824c31e55c0573f8 Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-TestMinimumBasicScenario-3322305 Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-TestMinimumBasicScenario-3322305-project Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: e64f94da55234c21889ecf1cd2220ed5 Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-TestMinimumBasicScenario-3322305-project Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:18:36.466698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 is not attached to volume d1b2dcdf-483f-407f-af33-1a757127e1ee Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'server_id': '77faab74-d45f-43e0-98a0-047afa7f4ab1', 'id': 'd1b2dcdf-483f-407f-af33-1a757127e1ee'} Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d1b2dcdf-483f-407f-af33-1a757127e1ee. Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:18:36.467644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 is not attached to volume d1b2dcdf-483f-407f-af33-1a757127e1ee Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 is not attached to volume d1b2dcdf-483f-407f-af33-1a757127e1ee Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:36.469114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Returning 404 to user: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 is not attached to volume d1b2dcdf-483f-407f-af33-1a757127e1ee {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:18:36.470271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5b2b9888-2edd-49a9-8f4d-216548bc3023 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "DELETE /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments/d1b2dcdf-483f-407f-af33-1a757127e1ee" status: 404 len: 154 microversion: 2.1 time: 0.094255 Sep 01 09:18:36.470271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 424/833] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:18:36 2022] DELETE /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1/os-volume_attachments/d1b2dcdf-483f-407f-af33-1a757127e1ee => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 09:18:36.991942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:36.992648 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:36.999260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:36.999902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:37.000431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:37.001237 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:37.001763 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:37.002203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:37.077217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:37.085662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-94c2071e-11a7-4d01-9837-228eb7c8ebc5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1293 microversion: 2.1 time: 0.097819 Sep 01 09:18:37.086226 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 410/834] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:36 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:18:37.763017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:37.764629 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:37.776958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:37.777468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:37.777917 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:37.778618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:37.779078 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:37.779537 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:37.807881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:18:38.107150 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:38.107673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:38.115780 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:38.119027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:38.119027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:38.119027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:38.119027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:38.119512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:38.142502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-da1057d9-9b75-4fec-babc-0b37ea0c72fa tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "DELETE /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 204 len: 0 microversion: 2.1 time: 0.382418 Sep 01 09:18:38.144636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 425/835] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:18:37 2022] DELETE /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:18:38.169517 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:38.170223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:38.181705 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:38.182420 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:38.183192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:38.184072 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:38.184686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:38.185272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:38.206870 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:38.215734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0a0b0efb-0d51-4010-8f7c-ef6412a43ed4 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1299 microversion: 2.1 time: 0.112592 Sep 01 09:18:38.216318 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 411/836] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:38 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:18:38.398004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:38.409635 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f4d4aa35-7bd8-4dc8-bd4f-e7d06397f079 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1555 microversion: 2.1 time: 0.246068 Sep 01 09:18:38.410221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 426/837] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:38 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:39.168354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:39.168882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:39.175076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:39.175577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:39.176009 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:39.176746 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:39.177338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:39.177760 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:39.201679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4c5001b5-6598-4281-b78d-4f2db182f21a tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/ips" status: 200 len: 152 microversion: 2.20 time: 0.037057 Sep 01 09:18:39.202293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 412/838] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Sep 1 09:18:39 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 09:18:39.238158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:39.239577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:39.247554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:39.248214 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:39.248646 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:39.249499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:39.249950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:39.250539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:39.425120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:39.430334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:39.431200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:39.432944 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f81caf38-928d-4aef-8b23-397339520fd2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.198607 Sep 01 09:18:39.433521 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 427/839] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:39 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:39.437630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:39.438121 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:39.438560 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:39.439327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:39.441151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:39.441747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:39.579827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:39.587740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7a6e9fb5-fc83-4342-ad3c-864bc8073c5f tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1555 microversion: 2.1 time: 0.161314 Sep 01 09:18:39.588305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 413/840] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:39 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:40.454119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:40.454773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:40.458501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:40.463584 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:40.464706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:40.464706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:40.467882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-f480b296-361e-4c21-a1cb-874fb9f547d7 req-4a075e69-2fab-480f-a86b-476f1d6f6638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0945998-19f2-47a9-8df8-da3228ea1a51", "tag": "c1aa7bb4-cfea-429e-9f27-e60d8f478cdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:40.470787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:40.472125 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:40.472684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:40.485523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-f480b296-361e-4c21-a1cb-874fb9f547d7 req-4a075e69-2fab-480f-a86b-476f1d6f6638 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:40.489849 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-f480b296-361e-4c21-a1cb-874fb9f547d7 req-4a075e69-2fab-480f-a86b-476f1d6f6638 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:40.490531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-f480b296-361e-4c21-a1cb-874fb9f547d7 req-4a075e69-2fab-480f-a86b-476f1d6f6638 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:40.506263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-f480b296-361e-4c21-a1cb-874fb9f547d7 req-4a075e69-2fab-480f-a86b-476f1d6f6638 service nova] Creating event network-changed:c1aa7bb4-cfea-429e-9f27-e60d8f478cdc for instance b0945998-19f2-47a9-8df8-da3228ea1a51 on hv-cinder-82002 Sep 01 09:18:40.512867 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-f480b296-361e-4c21-a1cb-874fb9f547d7 req-4a075e69-2fab-480f-a86b-476f1d6f6638 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049639 Sep 01 09:18:40.514146 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 414/841] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:40.615956 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:40.616920 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:40.628089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:40.629207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:40.629877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:40.631932 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:40.634323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:40.634819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:40.678559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:40.686672 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-37b7c9ed-119f-4e40-a3bc-f87c4d18922b tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.236364 Sep 01 09:18:40.699563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 428/842] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:40 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:40.858689 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:40.868041 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7361893e-7afb-4372-9b4d-58cd8313fb07 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1555 microversion: 2.1 time: 0.262041 Sep 01 09:18:40.868816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 415/843] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:40 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:18:41.178011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-7b5c574e-5f4a-48b6-8b1c-fa16c509eb4b req-e86fe544-c7a5-4212-895f-0791de873175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77faab74-d45f-43e0-98a0-047afa7f4ab1", "name": "network-vif-deleted", "tag": "59adb5de-03d0-4adf-8b66-fa4fd1d06955"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:41.190228 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-7b5c574e-5f4a-48b6-8b1c-fa16c509eb4b req-e86fe544-c7a5-4212-895f-0791de873175 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:41.190928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-7b5c574e-5f4a-48b6-8b1c-fa16c509eb4b req-e86fe544-c7a5-4212-895f-0791de873175 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:41.191390 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-7b5c574e-5f4a-48b6-8b1c-fa16c509eb4b req-e86fe544-c7a5-4212-895f-0791de873175 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:41.203242 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-7b5c574e-5f4a-48b6-8b1c-fa16c509eb4b req-e86fe544-c7a5-4212-895f-0791de873175 service nova] Creating event network-vif-deleted:59adb5de-03d0-4adf-8b66-fa4fd1d06955 for instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 on hv-cinder-82002 Sep 01 09:18:41.209522 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-7b5c574e-5f4a-48b6-8b1c-fa16c509eb4b req-e86fe544-c7a5-4212-895f-0791de873175 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037586 Sep 01 09:18:41.211021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 429/844] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:41.710113 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:41.710793 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:41.718736 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:41.719263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:41.720409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:41.721962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:41.722720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:41.723178 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:41.743733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=100 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:41.891289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:41.892121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:41.898997 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:41.899534 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:41.899967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:41.900697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:41.901513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:41.902585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:41.921557 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:41.930161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-831e7d98-afe7-408e-80c3-edc5435eca3e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.225434 Sep 01 09:18:41.930831 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 416/845] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:41 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:41.939249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:41.940463 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:41.940895 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:41.941339 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lazy-loading 'fault' on Instance uuid 77faab74-d45f-43e0-98a0-047afa7f4ab1 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:41.983422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:41.991784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-651a3704-a271-44e3-8493-22e7472ac798 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1348 microversion: 2.1 time: 0.106092 Sep 01 09:18:41.992492 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 430/846] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:41 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:42.474358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:42.474904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:42.480852 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:42.481343 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:42.481781 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:42.482927 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:42.483410 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:42.483845 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:42.507845 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lazy-loading 'flavor' on Instance uuid e798b2fb-1903-448d-b38e-5e8c48dfc9eb {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:42.954714 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:42.955774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:42.963128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:42.963658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:42.964098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:42.964796 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:42.965274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:42.965684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:42.977747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a648c654-5fa9-402b-85f1-560529d45faf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/action" status: 202 len: 0 microversion: 2.20 time: 0.507599 Sep 01 09:18:42.978339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 417/847] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Sep 1 09:18:42 2022] POST /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:18:42.987957 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:42.993278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:42.996088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:42.996574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:42.997010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:42.997705 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:42.998160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:42.998587 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:43.113432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:43.123659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-70361d44-5a09-46e8-804c-9c333cdaed8e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.172994 Sep 01 09:18:43.123659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 431/848] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:42 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:18:43.126966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:43.127768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:43.133952 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:43.134653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:43.135324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:43.136322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:43.136782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:43.137210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:43.152154 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:43.161774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:43.165596 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:43.165596 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-730d70ae-0538-4373-9cb5-c946c080a658 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.181598 Sep 01 09:18:43.165596 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 418/849] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:42 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:18:43.171383 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:43.171975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:43.172479 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:43.172998 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lazy-loading 'fault' on Instance uuid 77faab74-d45f-43e0-98a0-047afa7f4ab1 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:43.217566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:43.225881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a6701626-e6b6-46a3-832f-7d09e8ca49c1 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1348 microversion: 2.1 time: 0.103158 Sep 01 09:18:43.226445 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 432/850] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:43 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:44.143162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:44.143775 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:44.149984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:44.150468 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:44.150898 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:44.151609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:44.152192 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:44.152723 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:44.188853 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:44.189983 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:44.196969 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:44.198618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:44.198618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:44.198794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:44.199191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:44.199622 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:44.295078 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:44.304532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4c23511b-b543-473b-b193-395a9e4bdb3d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.165401 Sep 01 09:18:44.305207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 419/851] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:44 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:44.318514 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:44.319560 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:44.326537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:44.330690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:44.330690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:44.330690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:44.330690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:44.331089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:44.339866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:44.348984 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:44.355230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:44.355230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-82c54ee4-c149-4d6b-81f0-8c6408b1cb67 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.167051 Sep 01 09:18:44.355230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 433/852] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:44 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:18:44.366034 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:44.366524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:44.366962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:44.367435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lazy-loading 'fault' on Instance uuid 77faab74-d45f-43e0-98a0-047afa7f4ab1 {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:18:44.408604 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64f94da55234c21889ecf1cd2220ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14201dd9cdf946d2824c31e55c0573f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:44.416400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cd5917f8-a36e-4b20-9839-44ded267b2d6 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 200 len: 1348 microversion: 2.1 time: 0.109951 Sep 01 09:18:44.416980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 420/853] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:44 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:45.325655 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:45.326267 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:45.328256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:45.333718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:45.334204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:45.334637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:45.335357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:45.335859 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:45.337583 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:45.376073 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:45.377455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:45.379420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:45.380082 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=10 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:45.385417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:45.385903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:45.386362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:45.387059 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:45.387540 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:45.387964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:45.479129 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:45.495557 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-642d244b-8245-45c7-b33b-5afc1cde22f7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.173580 Sep 01 09:18:45.496254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 434/854] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:45 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:45.502342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:45.503094 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] [instance: 77faab74-d45f-43e0-98a0-047afa7f4ab1] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:45.510361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:45.510960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:45.511512 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:45.512330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:45.512881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:45.513405 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:45.528912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] HTTP exception thrown: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 could not be found. Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Request method failure captured: Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 HTTP/1.1 Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHf3_a58Cq0mxPxzImTjrvrEMHHrgB7esyKQwhfOYfasElYdyeh8HY4kLXElw-V1MeXsfIToKDhetTuw00BsyNmqF5q3mGrsIF2NCWesfDx6rD_GrndBnlTPAHf34BApiOlqzzDuoBvk3B8IBKWCCpJo2dr0eiX7YCKi1fbFxprwkyo Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 14201dd9cdf946d2824c31e55c0573f8 Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-TestMinimumBasicScenario-3322305 Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:18:45.530920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/14201dd9cdf946d2824c31e55c0573f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_14201dd9cdf946d2824c31e55c0573f8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/14201dd9cdf946d2824c31e55c0573f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/14201dd9cdf946d2824c31e55c0573f8"}]}] Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-TestMinimumBasicScenario-3322305 Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 14201dd9cdf946d2824c31e55c0573f8 Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-TestMinimumBasicScenario-3322305 Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-TestMinimumBasicScenario-3322305-project Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: e64f94da55234c21889ecf1cd2220ed5 Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-TestMinimumBasicScenario-3322305-project Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 could not be found. Sep 01 09:18:45.533547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '77faab74-d45f-43e0-98a0-047afa7f4ab1'} Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 could not be found. Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:18:45.534476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 could not be found. Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 could not be found. Sep 01 09:18:45.540662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:18:45.542018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Returning 404 to user: Instance 77faab74-d45f-43e0-98a0-047afa7f4ab1 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:18:45.542018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-82f56f8f-ed53-49cf-98a1-7190497b1fb9 tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1" status: 404 len: 111 microversion: 2.1 time: 0.036972 Sep 01 09:18:45.542018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 435/855] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:45 2022] GET /compute/v2.1/servers/77faab74-d45f-43e0-98a0-047afa7f4ab1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:18:45.543910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-28a2a66c-70ea-4316-b6fc-4f9d72f4213c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] Calling method '.version_select at 0x7f7a68d1bee0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:45.544786 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:45.553996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:45.555860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:45.556731 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8ec64f5e-f312-42c3-a273-13c1e2c07874 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.184541 Sep 01 09:18:45.557296 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 421/856] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:45 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:18:45.647632 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-28a2a66c-70ea-4316-b6fc-4f9d72f4213c tempest-TestMinimumBasicScenario-3322305 tempest-TestMinimumBasicScenario-3322305-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1365158653" status: 202 len: 0 microversion: 2.1 time: 0.108250 Sep 01 09:18:45.648217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 436/857] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Sep 1 09:18:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1365158653 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:18:46.515533 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:46.516145 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:46.522818 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:46.523342 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:46.523784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:46.524507 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:46.524958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:46.525383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:46.585448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:46.585972 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:46.595832 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:46.596437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:46.596873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:46.597696 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:46.598015 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:46.598438 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:46.669055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:46.678089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9ae3a9fe-0707-4258-9bc4-c8f739a75058 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.166348 Sep 01 09:18:46.682258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 422/858] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:46 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:46.736314 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:46.744608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:46.746045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:46.747366 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f6a7cc81-7dac-4a1b-be7d-7da10f7d56b4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.166498 Sep 01 09:18:46.747920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 437/859] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:46 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:18:47.700004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:47.700721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:47.707984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:47.708497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:47.708940 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:47.709637 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:47.710094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:47.710523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:47.771661 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:47.772277 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:47.778784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:47.779321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:47.779764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:47.780491 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:47.780950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:47.781384 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:47.903307 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:47.911381 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c56886c6-0f1c-4fc2-928f-7374eff01219 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.215162 Sep 01 09:18:47.912925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 423/860] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:47 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:47.914748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:47.923087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:47.924684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:47.926044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-428d389f-c018-4146-83ec-85f2caa2a391 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.158260 Sep 01 09:18:47.926679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 438/861] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:47 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:18:48.271373 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-1383206a-7551-4066-8303-d4d7c44f98ce req-d2dfea13-d618-42bf-9075-f648237d36e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0945998-19f2-47a9-8df8-da3228ea1a51", "name": "network-vif-plugged", "status": "completed", "tag": "c1aa7bb4-cfea-429e-9f27-e60d8f478cdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:48.282153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1383206a-7551-4066-8303-d4d7c44f98ce req-d2dfea13-d618-42bf-9075-f648237d36e0 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:48.282641 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1383206a-7551-4066-8303-d4d7c44f98ce req-d2dfea13-d618-42bf-9075-f648237d36e0 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:48.283706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1383206a-7551-4066-8303-d4d7c44f98ce req-d2dfea13-d618-42bf-9075-f648237d36e0 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:48.295032 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-1383206a-7551-4066-8303-d4d7c44f98ce req-d2dfea13-d618-42bf-9075-f648237d36e0 service nova] Creating event network-vif-plugged:c1aa7bb4-cfea-429e-9f27-e60d8f478cdc for instance b0945998-19f2-47a9-8df8-da3228ea1a51 on hv-cinder-82002 Sep 01 09:18:48.301539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-1383206a-7551-4066-8303-d4d7c44f98ce req-d2dfea13-d618-42bf-9075-f648237d36e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Sep 01 09:18:48.302272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 424/862] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:48.933147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:48.933761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:48.941055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:48.941549 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:48.941990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:48.945139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:48.945139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:48.945139 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:48.950619 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:48.951424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:48.962059 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:48.963516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:48.964203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:48.966296 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:48.968090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:48.969383 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:49.122921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:49.127986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:49.137570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0dd5b4bf-26f6-4799-9eb8-a4c3027c821e tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.208190 Sep 01 09:18:49.138374 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 439/863] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:48 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:49.139595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:49.141087 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:49.143161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-87d91587-efc2-48c0-bb88-456d4ad0f371 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.197552 Sep 01 09:18:49.144269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 425/864] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:48 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:18:50.160521 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:50.161175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:50.168957 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:50.169474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:50.180288 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:50.182625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:50.184237 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:50.185074 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:50.185489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:50.188841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:50.194011 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:50.196250 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:50.196964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:50.213851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:50.220649 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:50.221593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:50.222232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:50.409197 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:50.415877 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:18:50.426659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-30588fe2-2d0a-4e15-b287-d9ae329a6b63 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1366 microversion: 2.1 time: 0.271068 Sep 01 09:18:50.427996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 440/865] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:50 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:50.522023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:50.534621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:50.537035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:50.538243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3eef0730-7896-48b5-9a33-b6a310b9ec35 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.371893 Sep 01 09:18:50.538830 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 426/866] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:50 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:18:51.449868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:51.450728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:51.461989 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:51.462587 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:51.463024 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:51.463935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:51.464388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:51.464810 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:51.562922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:51.564148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:51.570667 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:51.571283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:51.571793 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:51.572573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:51.573246 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:51.573774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:51.609270 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:51.617861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dccce2aa-7617-42ee-82a8-0bb84a36f7d6 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1556 microversion: 2.1 time: 0.173733 Sep 01 09:18:51.618446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 441/867] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:18:51 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:18:51.638478 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:51.638970 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:51.646314 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:51.646804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:51.647330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:51.647969 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:51.648419 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:51.648896 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:51.734955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-59c0ccdc-57fe-4242-80ca-8a58c25b3899 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100170 Sep 01 09:18:51.735697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 442/868] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Sep 1 09:18:51 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:18:51.795740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:51.804010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:51.805493 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:51.806892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9984f740-f843-47c2-a827-2eaac556f19c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.249349 Sep 01 09:18:51.819435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 427/869] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:51 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:18:52.833277 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:52.834625 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:52.841760 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:52.842372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:52.842904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:52.843866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:52.844740 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:52.845490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:53.134943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:53.144291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:53.146759 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:53.148423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d77a0d47-d183-4435-9ace-6deb36033a52 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.320487 Sep 01 09:18:53.167275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 443/870] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:52 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:18:53.205323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-0cdad30f-0fc0-4571-b6f5-492e60e89a96 req-0629360a-9ef3-4786-94e0-e66d0a4c4e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0945998-19f2-47a9-8df8-da3228ea1a51", "tag": "c1aa7bb4-cfea-429e-9f27-e60d8f478cdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:18:53.215649 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-0cdad30f-0fc0-4571-b6f5-492e60e89a96 req-0629360a-9ef3-4786-94e0-e66d0a4c4e43 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:53.218074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-0cdad30f-0fc0-4571-b6f5-492e60e89a96 req-0629360a-9ef3-4786-94e0-e66d0a4c4e43 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:53.218074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-0cdad30f-0fc0-4571-b6f5-492e60e89a96 req-0629360a-9ef3-4786-94e0-e66d0a4c4e43 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:53.228424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-0cdad30f-0fc0-4571-b6f5-492e60e89a96 req-0629360a-9ef3-4786-94e0-e66d0a4c4e43 service nova] Creating event network-changed:c1aa7bb4-cfea-429e-9f27-e60d8f478cdc for instance b0945998-19f2-47a9-8df8-da3228ea1a51 on hv-cinder-82002 Sep 01 09:18:53.233714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-0cdad30f-0fc0-4571-b6f5-492e60e89a96 req-0629360a-9ef3-4786-94e0-e66d0a4c4e43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032931 Sep 01 09:18:53.234397 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 428/871] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:18:54.174064 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:54.174688 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:54.181017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:54.181508 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:54.181945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:54.182650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:54.183173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:54.190346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:54.326085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:54.334490 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:54.335881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:54.337051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-be9368aa-d7dd-4791-8291-dea0068d20c2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.168176 Sep 01 09:18:54.337925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 444/872] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:54 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:18:55.361681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:55.362385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:55.368577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:55.369058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:55.369499 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:55.370195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:55.370664 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:55.371095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:55.501097 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:55.509273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:55.510739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:55.511943 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7897bee8-2848-4e20-9269-bc00e4a5ce3b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.155747 Sep 01 09:18:55.512703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 429/873] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:55 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:18:56.535793 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:56.536405 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:56.543860 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:56.544349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:56.544780 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:56.545476 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:56.545925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:56.546344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:56.685791 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:56.695401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:56.696907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:56.698212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bf69df11-82dc-4987-a15f-dbab919c4716 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.167498 Sep 01 09:18:56.698977 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 445/874] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:56 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:18:57.721861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:57.722373 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:57.728966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:57.729444 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:57.729877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:57.730973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:57.731452 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:57.731875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:57.864650 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:57.872768 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:57.874256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:57.876453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2c850287-07d6-46c1-a7ec-72db92675c4d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.158627 Sep 01 09:18:57.877057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 430/875] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:57 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:18:58.900547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:18:58.901135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:18:58.907843 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:58.908319 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:58.908750 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:58.909427 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:18:58.909911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:18:58.910326 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:18:59.042412 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:59.051384 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:59.053017 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:18:59.054475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c4d70037-9779-4175-83fb-a9e91eaefdb2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.158012 Sep 01 09:18:59.055042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 446/876] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:18:58 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:00.078351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:00.081799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:00.085877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:00.086361 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:00.086792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:00.087517 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:00.088020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:00.088443 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:00.219190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:00.227450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:00.228882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:00.230297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c092c9a8-e380-45a5-a32f-e300235f5d72 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.156326 Sep 01 09:19:00.230931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 431/877] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:00 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:01.253477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:01.254088 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:01.260554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:01.261043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:01.261481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:01.262166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:01.262623 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:01.263050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:01.395896 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:01.404572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:01.406047 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:01.408196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-55a44f41-2f46-4f13-a9b2-461e2464567f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1745 microversion: 2.20 time: 0.158021 Sep 01 09:19:01.408196 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 447/878] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:01 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:02.431263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:02.431876 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:02.438607 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:02.439122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:02.439562 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:02.440258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:02.440716 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:02.441145 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:02.445371 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:02.643002 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:02.661370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:02.662875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:02.664083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-72ee6e91-c912-4b28-80fa-7fb21122621e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1745 microversion: 2.20 time: 0.236891 Sep 01 09:19:02.664698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 432/879] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:02 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:03.688364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:03.693886 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:03.695681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:03.696159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:03.696601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:03.697318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:03.697768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:03.698189 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:03.825371 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:03.833525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:03.834943 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:03.836265 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dfb913e8-c534-4318-86cb-53e8de275ad5 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1745 microversion: 2.20 time: 0.152688 Sep 01 09:19:03.836758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 448/880] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:03 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:19:04.302705 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-8569a2f7-dcb6-4525-82da-44a210363b76 req-4d8fc1ff-f462-4a55-bdf0-494aa365ee67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e798b2fb-1903-448d-b38e-5e8c48dfc9eb", "name": "network-vif-plugged", "status": "completed", "tag": "1ec1e41f-a73b-40d9-a062-d63261502fdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:19:04.313465 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-8569a2f7-dcb6-4525-82da-44a210363b76 req-4d8fc1ff-f462-4a55-bdf0-494aa365ee67 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:04.313942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-8569a2f7-dcb6-4525-82da-44a210363b76 req-4d8fc1ff-f462-4a55-bdf0-494aa365ee67 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:04.314373 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-8569a2f7-dcb6-4525-82da-44a210363b76 req-4d8fc1ff-f462-4a55-bdf0-494aa365ee67 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:04.325381 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-8569a2f7-dcb6-4525-82da-44a210363b76 req-4d8fc1ff-f462-4a55-bdf0-494aa365ee67 service nova] Creating event network-vif-plugged:1ec1e41f-a73b-40d9-a062-d63261502fdc for instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb on hv-cinder-82002 Sep 01 09:19:04.330905 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-8569a2f7-dcb6-4525-82da-44a210363b76 req-4d8fc1ff-f462-4a55-bdf0-494aa365ee67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 Sep 01 09:19:04.331532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 433/881] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:04.860544 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:04.861320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:04.867731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:04.868205 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:04.868637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:04.869315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:04.869768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:04.870184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:05.002372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:05.010441 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:05.015000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:05.015000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-619349c6-166f-4810-9292-47ed408184ea tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1745 microversion: 2.20 time: 0.157108 Sep 01 09:19:05.015000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 449/882] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:04 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:06.037084 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:06.037770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:06.044002 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:06.044479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:06.044909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:06.045594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:06.046044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:06.046471 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:06.217344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:06.226655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:06.228250 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:06.229687 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b9a9bace-53b4-41eb-888d-1bbda01fb1a0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1745 microversion: 2.20 time: 0.198053 Sep 01 09:19:06.230253 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 434/883] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:06 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:07.253301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:07.253908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:07.260611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:07.261092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:07.261525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:07.262208 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:07.262664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:07.263089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:07.398996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:07.408142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:07.409627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:07.410789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4f3371ac-1343-471c-b0a4-5b72ea8da695 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1745 microversion: 2.20 time: 0.162010 Sep 01 09:19:07.411389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 450/884] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:07 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:08.433872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:08.434581 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:08.441790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:08.442280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:08.442719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:08.443455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:08.444127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:08.444739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:08.585173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:08.593622 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:08.595087 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:08.596791 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9597bcea-af7f-43dd-85b0-43105cc936b6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.166877 Sep 01 09:19:08.597686 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 435/885] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:08 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:09.621667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:09.622255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:09.629491 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:09.630054 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:09.630575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:09.631355 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:09.631876 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:09.632459 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:09.778156 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:09.786846 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:09.788424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:09.789817 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a1f00faa-a94a-474e-b21b-1e9694e02f83 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.172043 Sep 01 09:19:09.790387 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 451/886] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:09 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:10.813990 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:10.814649 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:10.822212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:10.822746 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:10.823243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:10.823993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:10.824497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:10.825003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:10.967504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:10.977164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:10.978892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:10.980096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5aab60a2-ef6f-4068-b787-aab85c80ebfd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.171803 Sep 01 09:19:10.980670 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 436/887] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:10 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:12.003224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:12.003840 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:12.006009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:12.011071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:12.017637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:12.017637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:12.017637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:12.017637 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:12.017990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:12.151021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:12.160103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:12.161839 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:12.162989 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a44c790d-875c-448d-a288-6eb1785587ed tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.163841 Sep 01 09:19:12.163601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 452/888] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:11 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:13.186794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:13.188406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:13.195331 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:13.198899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:13.198899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:13.198899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:13.198899 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:13.199342 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:13.364853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:13.378393 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:13.380979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:13.382928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a8565b51-6503-40b3-8ac1-ec2d83143c64 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.200082 Sep 01 09:19:13.384390 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 437/889] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:13 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:14.409099 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:14.409945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:14.416579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:14.417083 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:14.417515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:14.418199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:14.418651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:14.419073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:14.585399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:14.596915 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:14.598414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:14.599665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-90cc0512-4902-4a28-aaaa-d7dc578a2c2c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.195655 Sep 01 09:19:14.600248 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 453/890] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:14 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:15.623959 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:15.624570 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:15.631156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:15.631659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:15.632107 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:15.632916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:15.633394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:15.633818 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:15.767656 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:15.776015 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:15.777452 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:15.778630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cc5c1346-d85e-470d-b3a3-bac0be483fd6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.158686 Sep 01 09:19:15.794384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 438/891] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:15 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:16.802243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:16.803533 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:16.810175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:16.810602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:16.811041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:16.811800 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:16.812299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:16.812731 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:16.974759 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:16.983550 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:16.984972 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:16.986195 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c4959de2-146c-4d0c-a373-e89858580170 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.188071 Sep 01 09:19:16.986942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 454/892] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:16 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:18.017881 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:18.018593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:18.027413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:18.028518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:18.028968 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:18.029692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:18.030157 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:18.030588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:18.177610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:18.186292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:18.187751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:18.189253 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9f30ab2d-ca0a-4baf-abb0-758d8c3971f8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.179176 Sep 01 09:19:18.190028 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 439/893] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:18 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:19.212962 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:19.213584 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:19.224422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:19.224422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:19.224422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:19.224422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:19.225551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:19.225551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:19.361954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:19.370712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:19.372168 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:19.373341 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d313f1cc-0a21-4815-824c-a64e517e00d7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.164285 Sep 01 09:19:19.383489 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 455/894] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:19 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:20.397600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:20.398207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:20.404659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:20.405138 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:20.405568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:20.406251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:20.406701 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:20.407787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:20.532991 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:20.541043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:20.542460 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:20.543710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8f3a9d35-10c8-45f1-a226-a20adb7efcc3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1740 microversion: 2.20 time: 0.150054 Sep 01 09:19:20.544283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 440/895] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:20 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:20.818121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:20.818638 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:20.825192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:20.825668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:20.826099 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:20.826799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:20.827281 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:20.827714 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:20.852816 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-10d6fcd5-718f-4d60-be7c-b6ca92ac1f2b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/ips" status: 200 len: 144 microversion: 2.1 time: 0.038888 Sep 01 09:19:20.853392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 456/896] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:19:20 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:21.569364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:21.570103 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:21.572430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=30 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:21.577066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:21.577549 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:21.577993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:21.578741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:21.579962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:21.580410 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:21.711304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:21.719365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:21.722769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:21.722769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-46677759-cf71-4fc5-8dbe-44d885d45d97 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1722 microversion: 2.20 time: 0.157327 Sep 01 09:19:21.723273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 441/897] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:21 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:19:22.746705 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:22.747360 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:22.754311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:22.754792 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:22.755260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:22.755942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:22.756391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:22.756811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:22.760678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=93 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:22.891968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:22.899986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:22.901419 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:22.902567 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b40255be-edb5-4b45-89af-669fcbdd55db tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1722 microversion: 2.20 time: 0.159977 Sep 01 09:19:22.903142 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 457/898] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:22 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:23.487846 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caf398b0-3868-42cb-9b6b-37d59c7c82f2"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:19:23.487846 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:23.493017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:23.493501 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:23.493938 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:23.494625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:23.495117 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:23.495524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:23.925185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:23.925847 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:23.932213 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:23.932697 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:23.933133 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:23.933814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:23.934272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:23.934699 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:24.064497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:24.072502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:24.073929 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:24.075082 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9447b4cc-e43a-4a3c-9d8b-76941e4fc108 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1725 microversion: 2.20 time: 0.153913 Sep 01 09:19:24.075665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 458/899] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:23 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:19:24.097767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c995567c-daf6-4210-908a-84300a4fa57a"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:19:24.100080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:24.106084 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:24.106570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:24.107011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:24.107725 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:24.108185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:24.108612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:24.297975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ea0093bc-a77b-404f-ab41-dc67e3e77dce tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817501 Sep 01 09:19:24.298590 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 442/900] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:19:23 2022] POST /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:24.405292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-1c03a55e-309c-4353-8196-a9c039e5d639 req-3809893e-c9b7-4fe8-b060-0910064832d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e798b2fb-1903-448d-b38e-5e8c48dfc9eb", "name": "network-vif-unplugged", "status": "completed", "tag": "1ec1e41f-a73b-40d9-a062-d63261502fdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:19:24.415355 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1c03a55e-309c-4353-8196-a9c039e5d639 req-3809893e-c9b7-4fe8-b060-0910064832d4 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:24.415839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1c03a55e-309c-4353-8196-a9c039e5d639 req-3809893e-c9b7-4fe8-b060-0910064832d4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:24.416269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-1c03a55e-309c-4353-8196-a9c039e5d639 req-3809893e-c9b7-4fe8-b060-0910064832d4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:24.430073 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.compute.server_external_events [req-1c03a55e-309c-4353-8196-a9c039e5d639 req-3809893e-c9b7-4fe8-b060-0910064832d4 service nova] Unable to find a host for instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb. Dropping event network-vif-unplugged {{(pid=121063) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 09:19:24.431027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-1c03a55e-309c-4353-8196-a9c039e5d639 req-3809893e-c9b7-4fe8-b060-0910064832d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029955 Sep 01 09:19:24.431711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 443/901] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 09:19:25.188400 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fbf01eb5-c1c3-462e-bc89-9c02080de2be tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.094370 Sep 01 09:19:25.188958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 459/902] 10.222.0.46 () {62 vars in 1364 bytes} [Thu Sep 1 09:19:24 2022] POST /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-volume_attachments => generated 188 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 09:19:25.317528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:25.318142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:25.325224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:25.330159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:25.330159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:25.330159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:25.330159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:25.330536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:25.970599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-09acdf79-82a5-4813-aa53-8518a37eedba tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-volume_attachments/c995567c-daf6-4210-908a-84300a4fa57a" status: 202 len: 0 microversion: 2.20 time: 0.656847 Sep 01 09:19:25.971156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 444/903] 10.222.0.46 () {60 vars in 1457 bytes} [Thu Sep 1 09:19:25 2022] DELETE /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-volume_attachments/c995567c-daf6-4210-908a-84300a4fa57a => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:19:26.031932 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:19:26.032672 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:26.039608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:26.040092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:26.040526 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:26.041218 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:26.041671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:26.042096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:26.071823 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121062) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 09:19:26.373908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6bd52d5e-58eb-4ded-934c-b2fe99f3133c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "POST /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/action" status: 202 len: 0 microversion: 2.20 time: 0.345711 Sep 01 09:19:26.375204 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 460/904] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Sep 1 09:19:26 2022] POST /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:19:26.383726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:26.383726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:26.390424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:26.390904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:26.391370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:26.392106 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:26.392601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:26.393030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:26.547209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:26.556627 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:26.558344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:26.559395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9c0c982c-622a-418a-8b5e-d8ff28a0cc7c tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1673 microversion: 2.20 time: 0.180680 Sep 01 09:19:26.559964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 445/905] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:26 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:27.582982 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:27.583706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:27.592200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:27.592693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:27.593132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:27.594202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:27.595077 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:27.595541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:27.728469 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:27.736361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:27.737788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:27.738922 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-cd06413e-662c-4bb6-87e2-503b767598b3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1675 microversion: 2.20 time: 0.160117 Sep 01 09:19:27.739500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 461/906] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:27 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:28.761897 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:28.762535 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:28.769329 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:28.769808 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:28.770347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:28.770928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:28.771419 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:28.772352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:28.788538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:28.909138 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:28.917480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:28.918909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:28.920112 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-164ced31-cdda-4324-9cf3-269f3a523de6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.162203 Sep 01 09:19:28.920690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 446/907] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:28 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:29.943614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:29.944968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:29.951480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:29.951973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:29.952414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:29.953116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:29.953575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:29.954002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:30.098289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:30.107811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:30.109348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:30.110591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b3663e4c-e9b6-4613-9ae0-9cde4b8b9ce4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.170913 Sep 01 09:19:30.111255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 462/908] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:29 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:31.134489 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:31.135025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:31.141698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:31.142190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:31.142725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:31.143459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:31.143975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:31.144447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:31.285935 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:31.295015 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:31.296551 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:31.297727 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0dd99daa-a1d5-483c-9356-d83382105039 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.167849 Sep 01 09:19:31.298300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 447/909] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:31 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:32.320480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:32.321103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:32.327986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:32.328483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:32.328928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:32.329631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:32.330089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:32.330620 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:32.464388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:32.473337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:32.474717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:32.477188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2d475191-1c7c-447b-8ca2-f6596f244252 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.160605 Sep 01 09:19:32.477866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 463/910] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:32 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:33.503048 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:33.503703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:33.511679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:33.512301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:33.512755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:33.513470 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:33.513936 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:33.514367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:33.675368 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:33.684265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:33.685697 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:33.686861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-58829cd0-25ff-48e7-9b10-e8bfd995a72e tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.188119 Sep 01 09:19:33.687468 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 448/911] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:33 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:34.711478 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:34.712248 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:34.719148 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:34.719920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:34.720364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:34.721080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:34.721539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:34.721968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:34.867770 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:34.876783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:34.878331 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:34.879631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7bb662e6-f767-4579-b3ce-ed7d9e8235bd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.171993 Sep 01 09:19:34.880200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 464/912] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:34 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:35.903567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:35.904817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:35.911529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:35.912017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:35.912461 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:35.914103 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:35.914618 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:35.915186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:36.072793 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:36.082079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:36.083541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:36.085247 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e2c67524-272f-4e04-a3be-5244c7c2a5c4 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.185269 Sep 01 09:19:36.085817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 449/913] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:35 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:37.108573 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:37.109289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:37.116916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:37.117540 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:37.117991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:37.118973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:37.119477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:37.119908 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:37.262367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:37.270765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:37.274085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:37.274085 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5f73f934-049b-4ddb-9531-8f04d443cb22 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.169586 Sep 01 09:19:37.274451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 465/914] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:37 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:38.297842 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:38.298404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:38.305696 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:38.306175 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:38.306609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:38.307349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:38.307811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:38.308234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:38.434587 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:38.442728 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:38.444859 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:38.446017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8b69b9b5-24b0-4089-a0fa-1ecfacdc9560 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.152199 Sep 01 09:19:38.446595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 450/915] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:38 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:39.468868 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:39.469503 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:39.476419 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:39.476898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:39.477332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:39.478011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:39.478460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:39.478878 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:39.604879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:39.612877 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:39.614291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:39.615481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ae2c157a-4f46-4c61-a405-09cf78a54792 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.150481 Sep 01 09:19:39.616038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 466/916] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:39 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:40.638196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:40.638800 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:40.645417 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:40.645892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:40.646321 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:40.647683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:40.648152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:40.648573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:40.779409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:40.787447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:40.789058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:40.790225 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-435687dc-7223-4621-9d91-8dc407e0d341 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.155961 Sep 01 09:19:40.790792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 451/917] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:40 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:41.813046 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:41.813586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:41.819643 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:41.820119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:41.820546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:41.821223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:41.821671 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:41.822095 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:41.954985 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:41.964135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:41.965769 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:41.966912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4e340ef2-d137-424d-a88f-34558a6c7ef3 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.157973 Sep 01 09:19:41.967500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 467/918] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:41 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:42.991486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:42.991870 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:42.999096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:42.999703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:43.000144 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:43.000851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:43.001313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:43.001855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:43.131766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:43.139894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:43.144576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:43.144576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-85fc9d05-0b12-4681-be0e-82bf8f6401b8 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.155347 Sep 01 09:19:43.144576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 452/919] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:42 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:44.165220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:44.165829 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:44.168198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:44.175718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:44.175718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:44.175718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:44.175718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:44.176071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:44.176071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:44.309010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:44.316944 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:44.318417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:44.319614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-4a764d44-facb-4d63-9ed5-270a447169cd tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.159060 Sep 01 09:19:44.320179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 468/920] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:44 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:44.576018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:44.578176 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:44.584958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:44.586856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:44.586856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:44.587888 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:44.588354 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:44.588792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:44.620830 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c3df6c30-a6a6-4882-a50b-5815187d4040 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048901 Sep 01 09:19:44.621539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 453/921] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:19:44 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:44.632040 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:44.632596 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:44.639252 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:44.639741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:44.640179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:44.640866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:44.641319 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:44.641763 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:44.670628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f3404008-e201-4ecc-8c08-e2c4b598e1b5 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/caf398b0-3868-42cb-9b6b-37d59c7c82f2" status: 200 len: 194 microversion: 2.1 time: 0.042509 Sep 01 09:19:44.671376 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 469/922] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Sep 1 09:19:44 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/caf398b0-3868-42cb-9b6b-37d59c7c82f2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:45.342442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:45.343068 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:45.349051 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:45.349790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:45.350234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:45.350928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:45.351416 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:45.352414 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:45.480161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:45.488283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:45.489748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:45.490890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-01c31877-72d2-4e9b-8549-a5c36042840f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.152477 Sep 01 09:19:45.491497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 454/923] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:45 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:46.206169 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf6d2132-70fe-44ad-b891-6d5647d17519"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:19:46.208578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:46.215651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:46.216752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:46.216752 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:46.217272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:46.217723 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:46.218144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:46.221767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:46.435221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-27a60003-5697-47c9-a8bb-a1f673b4a2f4 req-43a21152-ade1-45ef-b022-d46fec072bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e798b2fb-1903-448d-b38e-5e8c48dfc9eb", "name": "network-vif-plugged", "status": "completed", "tag": "1ec1e41f-a73b-40d9-a062-d63261502fdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:19:46.442881 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-27a60003-5697-47c9-a8bb-a1f673b4a2f4 req-43a21152-ade1-45ef-b022-d46fec072bc4 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:46.443475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-27a60003-5697-47c9-a8bb-a1f673b4a2f4 req-43a21152-ade1-45ef-b022-d46fec072bc4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:46.443908 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-27a60003-5697-47c9-a8bb-a1f673b4a2f4 req-43a21152-ade1-45ef-b022-d46fec072bc4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:46.455676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-27a60003-5697-47c9-a8bb-a1f673b4a2f4 req-43a21152-ade1-45ef-b022-d46fec072bc4 service nova] Creating event network-vif-plugged:1ec1e41f-a73b-40d9-a062-d63261502fdc for instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb on hv-cinder-82002 Sep 01 09:19:46.460730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-27a60003-5697-47c9-a8bb-a1f673b4a2f4 req-43a21152-ade1-45ef-b022-d46fec072bc4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 Sep 01 09:19:46.464283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 455/924] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:19:46.516750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:46.517580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:46.525367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:46.526181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:46.526782 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:46.527691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:46.529931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:46.530534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:46.678091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:46.686941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:46.688420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:46.691430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-87e79d37-a2a0-440d-8bba-1897070eca2b tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.178905 Sep 01 09:19:46.691430 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 456/925] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:46 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:47.043689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-63a31633-9c85-4089-bce2-97cdaf0af83b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "POST /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841337 Sep 01 09:19:47.044306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 470/926] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:19:46 2022] POST /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:47.713694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:47.714217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:47.720606 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:47.721084 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:47.721521 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:47.722207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:47.722691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:47.723141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:47.853365 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:47.861404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:47.862841 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:47.864029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-103e146a-cc65-40d1-8153-37a5a58cc933 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.154993 Sep 01 09:19:47.864588 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 457/927] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:47 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:48.889325 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:48.889946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:48.896102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:48.896590 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:48.897025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:48.897755 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:48.898211 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:48.898640 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:49.028845 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:49.037351 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:49.038783 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:49.041131 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-70ec6551-5830-4f17-a5d3-2c94fbe26aaf tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1731 microversion: 2.20 time: 0.155987 Sep 01 09:19:49.041704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 471/928] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:48 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:50.064532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:50.065153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:50.071772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:50.072260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:50.072703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:50.073395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:50.073856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:50.074287 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:50.205029 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:50.213642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:50.215068 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:19:50.216239 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c08afb53-7417-4eaf-a8e7-443cc978d29f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1718 microversion: 2.20 time: 0.155649 Sep 01 09:19:50.216800 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 458/929] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:19:50 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:19:55.623388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:55.625634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:55.632187 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:55.632757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:55.633197 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:55.633880 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:55.634440 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:55.634867 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:55.665462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-276741a2-62de-4467-8b9f-4aea37457a7f tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045400 Sep 01 09:19:55.666122 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 472/930] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:19:55 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:55.802740 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:55.803379 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:55.806002 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=36 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:55.810783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:55.811313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:55.811755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:55.812450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:55.812910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:55.813338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:55.844210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ae000313-4566-445b-a956-6c324717b71d tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/caf398b0-3868-42cb-9b6b-37d59c7c82f2" status: 200 len: 194 microversion: 2.1 time: 0.045407 Sep 01 09:19:55.844768 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 459/931] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Sep 1 09:19:55 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/caf398b0-3868-42cb-9b6b-37d59c7c82f2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:55.855123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:55.855664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:55.861704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:55.862195 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:55.862635 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:55.863372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:55.863835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:55.864264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:55.942834 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lazy-loading 'services' on Instance uuid 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:19:56.133953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-72d9240c-7d4c-4051-aa6d-f98f65b82cbf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/caf398b0-3868-42cb-9b6b-37d59c7c82f2" status: 202 len: 0 microversion: 2.1 time: 0.281863 Sep 01 09:19:56.134658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 473/932] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:19:55 2022] DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/caf398b0-3868-42cb-9b6b-37d59c7c82f2 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:19:58.306333 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:58.306847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:58.313450 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:58.313957 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:58.314388 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:58.315079 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:58.315541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:58.315984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:58.345045 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-788930d3-72f2-4a18-b900-a75f23d57e9a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/bf6d2132-70fe-44ad-b891-6d5647d17519" status: 200 len: 194 microversion: 2.1 time: 0.042725 Sep 01 09:19:58.345659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 460/933] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Sep 1 09:19:58 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/bf6d2132-70fe-44ad-b891-6d5647d17519 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:19:58.357358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:58.357936 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:58.364667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:58.366835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:58.366835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:58.366835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:58.366835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:58.367239 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:58.448970 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lazy-loading 'services' on Instance uuid 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:19:58.637151 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dc500ac9-4131-4e5f-94fb-ab6da9810e5a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/bf6d2132-70fe-44ad-b891-6d5647d17519" status: 202 len: 0 microversion: 2.1 time: 0.283812 Sep 01 09:19:58.637742 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 474/934] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:19:58 2022] DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments/bf6d2132-70fe-44ad-b891-6d5647d17519 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:19:59.805856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:59.817582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:59.817582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:59.817582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:59.817582 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:59.818167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:59.818167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:59.818167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:59.821607 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=84 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:19:59.848235 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2efec7fd-dc87-45ac-9e9d-e5c58bde096e tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046281 Sep 01 09:19:59.848802 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 461/935] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:19:59 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:19:59.959811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:19:59.962732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:19:59.969280 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:59.969761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:59.970210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:19:59.970875 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:19:59.971365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:19:59.971790 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:00.001348 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5f361abc-c1b8-4c9f-b9f8-7603cab12561 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045916 Sep 01 09:20:00.001889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 475/936] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:19:59 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:20:00.062364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:00.062900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:00.069047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:00.069543 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:00.069984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:00.070708 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:00.071201 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:00.071639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:00.096519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:20:00.409435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d5707d48-b60b-4447-b8e7-1daa4ae65776 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 204 len: 0 microversion: 2.1 time: 0.351092 Sep 01 09:20:00.410040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 462/937] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:00 2022] DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:20:00.418633 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:00.419281 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:00.425318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:00.425808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:00.426251 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:00.427029 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:00.427520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:00.427953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:00.558234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:00.566040 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1bfde304-6730-4db0-a7d6-c19c954584bf tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1672 microversion: 2.1 time: 0.151335 Sep 01 09:20:00.566612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 476/938] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:00 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:01.588441 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:01.589141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:01.595506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:01.595987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:01.596422 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:01.597111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:01.597814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:01.598239 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:01.725340 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:01.733381 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-14f9350a-864a-4aae-94e5-3f7d85e28f3b tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1672 microversion: 2.1 time: 0.149288 Sep 01 09:20:01.733944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 463/939] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:01 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:02.755524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:02.756141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:02.763222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:02.763715 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:02.764150 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:02.764853 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:02.765309 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:02.765739 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:02.984349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:02.992587 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d1711fbf-59e9-44a5-a840-d5d4e2c29700 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1672 microversion: 2.1 time: 0.240371 Sep 01 09:20:02.993222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 477/940] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:02 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1672 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:03.657668 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-a665b021-96b5-4737-893d-c327a87dd171 req-76eab52b-a847-4974-8a08-071a84b39dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6c0528-b9b4-44c3-860b-ab406b4c9d51", "name": "network-vif-deleted", "tag": "53fe1be0-1913-4628-9671-66a140324e18"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:20:03.672333 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a665b021-96b5-4737-893d-c327a87dd171 req-76eab52b-a847-4974-8a08-071a84b39dfe service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:03.672820 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a665b021-96b5-4737-893d-c327a87dd171 req-76eab52b-a847-4974-8a08-071a84b39dfe service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:03.673257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a665b021-96b5-4737-893d-c327a87dd171 req-76eab52b-a847-4974-8a08-071a84b39dfe service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:03.684661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-a665b021-96b5-4737-893d-c327a87dd171 req-76eab52b-a847-4974-8a08-071a84b39dfe service nova] Creating event network-vif-deleted:53fe1be0-1913-4628-9671-66a140324e18 for instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 on hv-cinder-82002 Sep 01 09:20:03.689761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-a665b021-96b5-4737-893d-c327a87dd171 req-76eab52b-a847-4974-8a08-071a84b39dfe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035901 Sep 01 09:20:03.690435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 464/941] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:20:04.014102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:04.014626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:04.022266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:04.022792 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:04.023279 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:04.023954 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:04.031031 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:04.031031 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:04.060651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:04.061283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:04.061813 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:04.062359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lazy-loading 'fault' on Instance uuid 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:20:04.109266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ab0c0b138457e9a5e9288d039b932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5045a17a253414e9c231bcd0d7d24b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:04.117220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-39396975-f305-44f1-816b-2dd1cd4b3743 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 200 len: 1327 microversion: 2.1 time: 0.107369 Sep 01 09:20:04.117799 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 478/942] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:04 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:05.138362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:05.138982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:05.145600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:05.146085 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:05.146524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:05.147249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:05.147709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:05.148138 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:05.164227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] HTTP exception thrown: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Request method failure captured: Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 HTTP/1.1 Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcCBu27VgQe9_gyTj0N1W1PaT5h7R_6f3O7vFJ6TXPEfHJnbxnEwmALz4XgjcyB0NiLxbSCc4z_tvAMzFO_dL10csFb6JX1rzmFyb0xbgjAPMzsJx8ItRvYNr4-dZUo0D2wlfic5a3WTY0jdmcBMloqGXcJBz13WCmr3A0foOeuXtc Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:05.167147 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f5045a17a253414e9c231bcd0d7d24b8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f5045a17a253414e9c231bcd0d7d24b8"}]}] Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 004ab0c0b138457e9a5e9288d039b932 Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:05.168812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '0c6c0528-b9b4-44c3-860b-ab406b4c9d51'} Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:05.169715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:05.171351 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:05.172711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Returning 404 to user: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:05.172711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-de6c389e-09cd-4843-b4f3-5904f63f4172 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 404 len: 111 microversion: 2.1 time: 0.034769 Sep 01 09:20:05.172711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 465/943] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:05 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:05.177646 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-07b96097-c698-4e85-bd72-ddc11f8b2333 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '.version_select at 0x7f7a68c9edc0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:05.277296 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-07b96097-c698-4e85-bd72-ddc11f8b2333 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-247843899" status: 202 len: 0 microversion: 2.1 time: 0.103356 Sep 01 09:20:05.277881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 479/944] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Sep 1 09:20:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-247843899 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:20:08.814303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:08.814303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:08.820099 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:08.820603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:08.821023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:08.821754 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:08.822269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:08.822723 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:08.836269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] HTTP exception thrown: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Request method failure captured: Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 HTTP/1.1 Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcCBu27VgQe9_gyTj0N1W1PaT5h7R_6f3O7vFJ6TXPEfHJnbxnEwmALz4XgjcyB0NiLxbSCc4z_tvAMzFO_dL10csFb6JX1rzmFyb0xbgjAPMzsJx8ItRvYNr4-dZUo0D2wlfic5a3WTY0jdmcBMloqGXcJBz13WCmr3A0foOeuXtc Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:08.838385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f5045a17a253414e9c231bcd0d7d24b8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f5045a17a253414e9c231bcd0d7d24b8"}]}] Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 004ab0c0b138457e9a5e9288d039b932 Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.849058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '0c6c0528-b9b4-44c3-860b-ab406b4c9d51'} Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:08.849993 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.851442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.853010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Returning 404 to user: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:08.853010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-61d37609-6996-4fde-af82-96c08a68495a tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 404 len: 111 microversion: 2.1 time: 0.030705 Sep 01 09:20:08.853010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 466/945] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:08 2022] DELETE /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:08.853313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:08.853313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 0c6c0528-b9b4-44c3-860b-ab406b4c9d51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:08.857209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:08.857709 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:08.858123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:08.858847 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:08.859362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:08.859785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:08.874569 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] HTTP exception thrown: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Request method failure captured: Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 HTTP/1.1 Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHcCBu27VgQe9_gyTj0N1W1PaT5h7R_6f3O7vFJ6TXPEfHJnbxnEwmALz4XgjcyB0NiLxbSCc4z_tvAMzFO_dL10csFb6JX1rzmFyb0xbgjAPMzsJx8ItRvYNr4-dZUo0D2wlfic5a3WTY0jdmcBMloqGXcJBz13WCmr3A0foOeuXtc Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:20:08.876234 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f5045a17a253414e9c231bcd0d7d24b8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f5045a17a253414e9c231bcd0d7d24b8"}]}] Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 004ab0c0b138457e9a5e9288d039b932 Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.877906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '0c6c0528-b9b4-44c3-860b-ab406b4c9d51'} Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:08.878819 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. Sep 01 09:20:08.880375 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:08.881728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Returning 404 to user: Instance 0c6c0528-b9b4-44c3-860b-ab406b4c9d51 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:08.881728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-89b037ad-3de8-402e-aa8b-8c35602ef1aa tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51" status: 404 len: 111 microversion: 2.1 time: 0.033381 Sep 01 09:20:08.881728 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 480/946] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:08 2022] GET /compute/v2.1/servers/0c6c0528-b9b4-44c3-860b-ab406b4c9d51 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:10.134059 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:10.135183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:10.140969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:10.141449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:10.141880 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:10.142559 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:10.143016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:10.143474 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:10.156836 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] HTTP exception thrown: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Request method failure captured: Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 HTTP/1.1 Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcCBu27VgQe9_gyTj0N1W1PaT5h7R_6f3O7vFJ6TXPEfHJnbxnEwmALz4XgjcyB0NiLxbSCc4z_tvAMzFO_dL10csFb6JX1rzmFyb0xbgjAPMzsJx8ItRvYNr4-dZUo0D2wlfic5a3WTY0jdmcBMloqGXcJBz13WCmr3A0foOeuXtc Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:10.158375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f5045a17a253414e9c231bcd0d7d24b8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f5045a17a253414e9c231bcd0d7d24b8"}]}] Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 004ab0c0b138457e9a5e9288d039b932 Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.159964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '8be4ee16-c20b-4744-9bb7-94a9afbb5415'} Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:10.160926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.162400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.164536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Returning 404 to user: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:10.164536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-79a50c09-c7f7-4e08-86c4-7cff8a531c87 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 404 len: 111 microversion: 2.1 time: 0.029526 Sep 01 09:20:10.164536 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 467/947] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:10 2022] DELETE /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:10.169019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:10.169636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] [instance: 8be4ee16-c20b-4744-9bb7-94a9afbb5415] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:10.176042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:10.176521 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:10.176956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:10.177689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:10.178147 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:10.178576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:10.192713 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] HTTP exception thrown: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Request method failure captured: Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 HTTP/1.1 Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHcCBu27VgQe9_gyTj0N1W1PaT5h7R_6f3O7vFJ6TXPEfHJnbxnEwmALz4XgjcyB0NiLxbSCc4z_tvAMzFO_dL10csFb6JX1rzmFyb0xbgjAPMzsJx8ItRvYNr4-dZUo0D2wlfic5a3WTY0jdmcBMloqGXcJBz13WCmr3A0foOeuXtc Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:20:10.194217 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f5045a17a253414e9c231bcd0d7d24b8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f5045a17a253414e9c231bcd0d7d24b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f5045a17a253414e9c231bcd0d7d24b8"}]}] Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: f5045a17a253414e9c231bcd0d7d24b8 Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1528966904 Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 004ab0c0b138457e9a5e9288d039b932 Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeTestJSON-1528966904-project Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.196058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '8be4ee16-c20b-4744-9bb7-94a9afbb5415'} Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:10.197048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. Sep 01 09:20:10.199051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:10.200396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] Returning 404 to user: Instance 8be4ee16-c20b-4744-9bb7-94a9afbb5415 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:10.200396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3e8f2808-1b90-4e2c-8b34-1e3ebdffcc75 tempest-AttachVolumeTestJSON-1528966904 tempest-AttachVolumeTestJSON-1528966904-project] 10.222.0.46 "GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415" status: 404 len: 111 microversion: 2.1 time: 0.031366 Sep 01 09:20:10.200396 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 481/948] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:10 2022] GET /compute/v2.1/servers/8be4ee16-c20b-4744-9bb7-94a9afbb5415 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:11.667982 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:11.668567 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:11.674851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:11.675369 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:11.675812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:11.676537 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:11.676996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:11.677425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:11.701773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e00fa887-0774-494a-ae72-65b6ed875c6c tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/ips" status: 200 len: 149 microversion: 2.1 time: 0.038724 Sep 01 09:20:11.702348 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 468/949] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:20:11 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:20:14.502824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16d3a3f7-a90a-41ee-866e-7cd1061d2d40"}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:20:14.505053 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:14.507485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:14.512114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:14.512593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:14.513024 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:14.513701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:14.514145 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:14.514569 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:15.532180 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a49784c5-96bc-482b-a92d-892cec586ca2 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "POST /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033147 Sep 01 09:20:15.532814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 482/950] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:20:14 2022] POST /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:20:23.167691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:23.168280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:23.170505 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:23.171195 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:23.175857 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:23.176344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:23.176782 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:23.177474 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:23.177928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:23.178352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:23.426093 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'services' on Instance uuid b0945998-19f2-47a9-8df8-da3228ea1a51 {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:20:23.673301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a612ca94-5e05-4dcc-89f9-7afd68b5bb01 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments/16d3a3f7-a90a-41ee-866e-7cd1061d2d40" status: 202 len: 0 microversion: 2.1 time: 0.510347 Sep 01 09:20:23.673980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 469/951] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:20:23 2022] DELETE /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments/16d3a3f7-a90a-41ee-866e-7cd1061d2d40 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:20:23.687472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:23.687472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:23.692314 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:23.692798 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:23.693229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:23.693919 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:23.694373 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:23.694805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:23.699127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:23.726198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-29a3ebea-0384-413a-b718-ab8282d8ad53 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047608 Sep 01 09:20:23.726966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 483/952] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:20:23 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:20:24.739475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:24.741761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:24.749049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:24.749539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:24.749975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:24.750721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:24.751198 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:24.751623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:24.781706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9c40aecb-926c-4033-b7cc-ad75f0e3b183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047500 Sep 01 09:20:24.782263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 470/953] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:20:24 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:20:25.794911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:25.797033 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:25.803814 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:25.804302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:25.809199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:25.809199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:25.809199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:25.809199 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:25.835322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-8c06e3f7-eff3-46ca-b723-b9d9c1ffb2cd tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044657 Sep 01 09:20:25.835866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 484/954] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Sep 1 09:20:25 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 09:20:25.896873 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:25.897476 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:25.904513 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:25.905070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:25.905515 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:25.906207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:25.906663 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:25.907092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:25.933851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:20:26.218227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-92cf6611-0f7f-4026-8ad6-f1f14d83bca9 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 204 len: 0 microversion: 2.1 time: 0.325564 Sep 01 09:20:26.218778 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 471/955] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:25 2022] DELETE /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:20:26.228289 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:26.228910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:26.234898 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:26.235474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:26.235925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:26.236611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:26.237071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:26.237503 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:26.367368 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:26.377827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-83a616b5-98cd-4d31-811e-f9c80a2d4e4d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1680 microversion: 2.1 time: 0.154451 Sep 01 09:20:26.379170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 485/956] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:26 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:27.400692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:27.401391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:27.407737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:27.408218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:27.408654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:27.409338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:27.409790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:27.410207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:27.545158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:27.552930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8802cc8c-3fe8-457f-8eca-2de4f61d1b62 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1680 microversion: 2.1 time: 0.156524 Sep 01 09:20:27.553504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 472/957] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:27 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:28.573966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:28.574660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:28.581290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:28.581767 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:28.582197 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:28.582885 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:28.583365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:28.583780 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:28.732524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:28.740462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2faf0f43-3190-4430-83ff-f32ba8bbfadc tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1680 microversion: 2.1 time: 0.170511 Sep 01 09:20:28.741043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 486/958] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:28 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:29.765107 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:29.766306 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:29.775469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:29.775960 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:29.777455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:29.777455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:29.777933 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:29.778366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:29.804101 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-f8f4a74b-7037-424c-abf5-65175d155439 req-39642668-0059-4df7-a22b-f8395e6e0764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0945998-19f2-47a9-8df8-da3228ea1a51", "name": "network-vif-deleted", "tag": "c1aa7bb4-cfea-429e-9f27-e60d8f478cdc"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:20:29.814778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-f8f4a74b-7037-424c-abf5-65175d155439 req-39642668-0059-4df7-a22b-f8395e6e0764 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:29.815510 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-f8f4a74b-7037-424c-abf5-65175d155439 req-39642668-0059-4df7-a22b-f8395e6e0764 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:29.816039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-f8f4a74b-7037-424c-abf5-65175d155439 req-39642668-0059-4df7-a22b-f8395e6e0764 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:29.828178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-f8f4a74b-7037-424c-abf5-65175d155439 req-39642668-0059-4df7-a22b-f8395e6e0764 service nova] Creating event network-vif-deleted:c1aa7bb4-cfea-429e-9f27-e60d8f478cdc for instance b0945998-19f2-47a9-8df8-da3228ea1a51 on hv-cinder-82002 Sep 01 09:20:29.833536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-f8f4a74b-7037-424c-abf5-65175d155439 req-39642668-0059-4df7-a22b-f8395e6e0764 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Sep 01 09:20:29.834871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 487/959] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:20:29.848101 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:29.861041 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0a254fa8-6654-49f4-b699-dd70eb85d999 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1613 microversion: 2.1 time: 0.100136 Sep 01 09:20:29.862576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 473/960] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:29 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1613 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:30.884090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:30.884945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:30.891554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:30.892039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:30.897055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:30.897055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:30.897055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:30.897055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:30.958030 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:30.966716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-407d3012-7092-499d-8241-e05a08a35290 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1613 microversion: 2.1 time: 0.088179 Sep 01 09:20:30.967329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 488/961] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:30 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:31.988438 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:31.988959 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:31.996200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:31.996694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:31.997132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:31.997821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:31.998275 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:31.998702 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:32.060229 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:32.067851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4fde2b79-b532-470d-aa4f-f867ba5161ec tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1613 microversion: 2.1 time: 0.083396 Sep 01 09:20:32.068425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 474/962] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:31 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:33.092761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:33.092761 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:33.098200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:33.098676 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:33.099182 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:33.099861 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:33.100311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:33.101383 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:33.131113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:33.131609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:33.132674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:33.133100 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lazy-loading 'fault' on Instance uuid b0945998-19f2-47a9-8df8-da3228ea1a51 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:20:33.176706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02240dc931e140498d82c6d91efb60c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1035740bd454149963828f12066b70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:33.184691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-bef6379c-49f2-4150-a086-583d7a310d28 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 200 len: 1331 microversion: 2.1 time: 0.097701 Sep 01 09:20:33.185254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 489/963] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:33 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:34.212826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:34.213524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:34.220520 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:34.221017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:34.221439 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:34.222123 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:34.222579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:34.225208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:34.240330 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 HTTP/1.1 Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:34.242597 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:34.244182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'b0945998-19f2-47a9-8df8-da3228ea1a51'} Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:34.245119 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:34.246434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:34.247690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:34.247690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2be31f22-0c03-41e8-aeb6-de78f3211183 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 404 len: 111 microversion: 2.1 time: 0.035515 Sep 01 09:20:34.247690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 475/964] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:34 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:34.253470 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5bb5a3ea-6786-405f-b823-31cad6374373 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '.version_select at 0x7f7a68c519d0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:34.319827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5bb5a3ea-6786-405f-b823-31cad6374373 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083225409" status: 202 len: 0 microversion: 2.1 time: 0.070309 Sep 01 09:20:34.320591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 490/965] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Sep 1 09:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083225409 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:20:36.310654 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:36.311204 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:36.317793 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:36.318284 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:36.318916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:36.319734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:36.320193 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:36.320662 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:36.334305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 HTTP/1.1 Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:36.336049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.337634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'b0945998-19f2-47a9-8df8-da3228ea1a51'} Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:36.338481 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.340141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.341856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:36.341856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-165f4b52-37d3-41c7-8b37-8442bfb926c7 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 404 len: 111 microversion: 2.1 time: 0.030998 Sep 01 09:20:36.341856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 476/966] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:36 2022] DELETE /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:36.347005 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:36.347682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: b0945998-19f2-47a9-8df8-da3228ea1a51] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:36.354894 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:36.355496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:36.355927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:36.356602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:36.357048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:36.357468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:36.374138 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 HTTP/1.1 Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:20:36.375842 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.377423 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'b0945998-19f2-47a9-8df8-da3228ea1a51'} Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:36.378304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. Sep 01 09:20:36.379849 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:36.381103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance b0945998-19f2-47a9-8df8-da3228ea1a51 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:36.381103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f7fd797b-7cca-4335-ab57-96d72afb941d tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51" status: 404 len: 111 microversion: 2.1 time: 0.035030 Sep 01 09:20:36.381103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 491/967] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:36 2022] GET /compute/v2.1/servers/b0945998-19f2-47a9-8df8-da3228ea1a51 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:37.652792 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:37.653280 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:37.659695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.660173 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.660698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.661387 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.661840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.662265 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.677083 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 HTTP/1.1 Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:37.678623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.680910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'c73bc5ef-57fb-47a3-844d-b8a0f88c4c12'} Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:37.681883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.683400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.685062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:37.685062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1f5b0fa5-fbb7-44d2-b0fb-492acc9f5aeb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 404 len: 111 microversion: 2.1 time: 0.031170 Sep 01 09:20:37.685062 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 477/968] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:37 2022] DELETE /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:37.689383 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:37.689991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: c73bc5ef-57fb-47a3-844d-b8a0f88c4c12] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:37.696510 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.696996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.697435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.698144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.698582 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.699008 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.712748 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 HTTP/1.1 Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:20:37.714253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.715873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'c73bc5ef-57fb-47a3-844d-b8a0f88c4c12'} Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:37.716754 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. Sep 01 09:20:37.718225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.719720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:37.719720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9490e48f-c8d5-4976-a25a-e4792cd1d942 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12" status: 404 len: 111 microversion: 2.1 time: 0.030234 Sep 01 09:20:37.719720 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 492/969] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:37 2022] GET /compute/v2.1/servers/c73bc5ef-57fb-47a3-844d-b8a0f88c4c12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:37.724314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:37.724805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:37.731546 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.734685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.734685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.734685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.734685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.735056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.747825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 HTTP/1.1 Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:37.749362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.751004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '16aac3dd-aaba-4552-80bd-3673dc9ffbe5'} Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:37.752197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.753721 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.755415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:37.755415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f3c3e1f9-843d-4815-b5e8-f724d08e8492 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 404 len: 111 microversion: 2.1 time: 0.030256 Sep 01 09:20:37.755415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 478/970] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:37 2022] DELETE /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:37.759634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:37.760254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: 16aac3dd-aaba-4552-80bd-3673dc9ffbe5] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:37.766337 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.771579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.771579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.771579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:37.771579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:37.771940 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:37.782669 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 HTTP/1.1 Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:20:37.784347 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.786481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '16aac3dd-aaba-4552-80bd-3673dc9ffbe5'} Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:37.787531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. Sep 01 09:20:37.789996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:37.791496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance 16aac3dd-aaba-4552-80bd-3673dc9ffbe5 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:37.791496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6fd1d8a9-32d0-4341-b20e-0d17fc57d3eb tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5" status: 404 len: 111 microversion: 2.1 time: 0.030299 Sep 01 09:20:37.791496 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 493/971] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:37 2022] GET /compute/v2.1/servers/16aac3dd-aaba-4552-80bd-3673dc9ffbe5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:39.085335 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:39.085848 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:39.092543 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:39.093102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:39.093471 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:39.094424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:39.094879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:39.095348 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:39.109258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 HTTP/1.1 Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:20:39.110948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.116467 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'af02f0cb-1acf-48dd-8868-42cd5ebfff97'} Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:39.117227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.119070 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.120541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:39.120541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2370b41f-7627-44b8-a965-37932c9ac3f5 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 404 len: 111 microversion: 2.1 time: 0.030860 Sep 01 09:20:39.120541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 479/972] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:20:39 2022] DELETE /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:39.121702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:39.122313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] [instance: af02f0cb-1acf-48dd-8868-42cd5ebfff97] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:39.129044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:39.129529 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:39.130048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:39.130764 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:39.131320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:39.131751 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:39.145326 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] HTTP exception thrown: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Request method failure captured: Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 HTTP/1.1 Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHb87YSighH4QXWu5bpRyDNles0luCk1CjS6kaV_RhdPqMcwsLRTVbv2LB83_lzGrH3ub1AOFo7OcY_3DpdtcH2BqQMhZN8rfURWCwLF_VoU0OBskt0NtimIMqOcdaKNJYnsG-f3QkO1qUjKGG5LwaiXwwIUxLRrvq8eVDWFI6_CnWs Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:20:39.146824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1035740bd454149963828f12066b70d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1035740bd454149963828f12066b70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1035740bd454149963828f12066b70d"}]}] Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: c1035740bd454149963828f12066b70d Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476824821 Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 02240dc931e140498d82c6d91efb60c8 Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeNegativeTest-1476824821-project Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.148509 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'af02f0cb-1acf-48dd-8868-42cd5ebfff97'} Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:20:39.149311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. Sep 01 09:20:39.150653 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:20:39.151824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] Returning 404 to user: Instance af02f0cb-1acf-48dd-8868-42cd5ebfff97 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:20:39.151824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f796be65-2356-4b6c-a233-b66468450674 tempest-AttachVolumeNegativeTest-1476824821 tempest-AttachVolumeNegativeTest-1476824821-project] 10.222.0.46 "GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97" status: 404 len: 111 microversion: 2.1 time: 0.031120 Sep 01 09:20:39.151824 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 494/973] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:20:39 2022] GET /compute/v2.1/servers/af02f0cb-1acf-48dd-8868-42cd5ebfff97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:20:55.186253 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:55.188571 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:55.190712 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:20:55.190865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-volume_attachments (ip 10.222.0.46) !!! Sep 01 09:20:55.192021 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:55.192688 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:55.200678 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:55.201579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:55.201579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:55.202269 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:55.202728 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:55.203188 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:55.234963 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5c29864f-aa76-4592-ad74-455e0f353ae7 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053281 Sep 01 09:20:55.236004 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 480/974] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Sep 1 09:20:55 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:20:55.299938 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:55.300459 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:55.303150 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:55.303821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=47 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:20:55.308835 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:55.310411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:55.310411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:55.310411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:55.310827 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:55.311284 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:55.339141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:20:55.679998 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-398a169f-0b80-4ddc-9365-fc9dd06f61e6 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 204 len: 0 microversion: 2.20 time: 0.383474 Sep 01 09:20:55.680965 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 495/975] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 09:20:55 2022] DELETE /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 09:20:55.690406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:55.691026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:55.698526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:55.699121 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:55.699621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:55.700320 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:55.700784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:55.701210 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:55.839122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:55.847912 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:55.849378 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:55.850557 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a55f4f90-8089-4e17-b6cf-f11db224a183 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.164626 Sep 01 09:20:55.851142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 481/976] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:20:55 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:20:56.874910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:56.875636 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:56.881975 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:56.882454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:56.882887 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:56.883591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:56.884043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:56.884466 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:57.014822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:57.022815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:57.024277 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:57.025430 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6c396801-1ae3-47ad-84bb-0687a9e6091d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.154768 Sep 01 09:20:57.026010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 496/977] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:20:56 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:20:58.048499 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:58.049111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:58.055907 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:58.056391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:58.056826 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:58.057861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:58.058315 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:58.058741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:58.189425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:58.198395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:58.199962 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:58.201131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-49304148-05f7-41b7-9cac-ab580127f316 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.156550 Sep 01 09:20:58.201729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 482/978] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:20:58 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:20:59.228469 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:20:59.229544 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:20:59.235927 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:59.236484 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:59.236825 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:59.237510 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:20:59.237961 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:20:59.238388 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:20:59.374025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:59.382176 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:59.383662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:20:59.384820 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f7503a68-a613-4ffe-af34-18bdc7d7c77f tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.160358 Sep 01 09:20:59.385372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 497/979] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:20:59 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:21:00.408353 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:00.408977 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:00.415435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:00.415918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:00.416357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:00.417682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:00.418384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:00.418817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:00.553192 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:00.562363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:00.563876 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:00.571878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-913fa630-8ef3-4508-afef-0b294f2761de tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.160604 Sep 01 09:21:00.571878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 483/980] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:21:00 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:21:01.588523 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:01.589157 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:01.596557 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:01.597282 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:01.598059 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:01.600484 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:01.600948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:01.601376 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:01.765644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:01.773656 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:01.775075 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:01.776338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e5d4f24f-13ef-4dbf-80f0-dfcbec0578e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1724 microversion: 2.20 time: 0.192291 Sep 01 09:21:01.776993 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 498/981] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:21:01 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 09:21:02.267193 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-ec3460e2-86f4-439c-8c8c-bc9627c3c334 req-09473130-200f-495b-9e55-8421764bd466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e798b2fb-1903-448d-b38e-5e8c48dfc9eb", "name": "network-vif-deleted", "tag": "1ec1e41f-a73b-40d9-a062-d63261502fdc"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:21:02.278391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-ec3460e2-86f4-439c-8c8c-bc9627c3c334 req-09473130-200f-495b-9e55-8421764bd466 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:02.279181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-ec3460e2-86f4-439c-8c8c-bc9627c3c334 req-09473130-200f-495b-9e55-8421764bd466 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:02.279790 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-ec3460e2-86f4-439c-8c8c-bc9627c3c334 req-09473130-200f-495b-9e55-8421764bd466 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:02.293293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-ec3460e2-86f4-439c-8c8c-bc9627c3c334 req-09473130-200f-495b-9e55-8421764bd466 service nova] Creating event network-vif-deleted:1ec1e41f-a73b-40d9-a062-d63261502fdc for instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb on hv-cinder-82002 Sep 01 09:21:02.300090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-ec3460e2-86f4-439c-8c8c-bc9627c3c334 req-09473130-200f-495b-9e55-8421764bd466 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185873 Sep 01 09:21:02.304698 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 484/982] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:21:02.799617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:02.800757 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:02.807270 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:02.807785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:02.808247 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:02.808904 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:02.809351 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:02.809777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:02.842404 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:02.842891 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:02.843412 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:02.844011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lazy-loading 'fault' on Instance uuid e798b2fb-1903-448d-b38e-5e8c48dfc9eb {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:21:02.900871 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:02.912125 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:02.915939 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d931a379404433b9c3c690dd9beb83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8799a08d0684b5c8d9cd3f89c3016d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:21:02.917644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-734c7701-ed9f-4a92-995a-dbc889dc43c9 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 200 len: 1371 microversion: 2.20 time: 0.121677 Sep 01 09:21:02.923551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 499/983] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:21:02 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 09:21:03.940300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:03.940913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:03.947493 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:03.957462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:03.957462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:03.957462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:03.957462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:03.957872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:03.963411 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] HTTP exception thrown: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Request method failure captured: Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb HTTP/1.1 Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcGlE_ApwWREQ1_FaCCpmJ-ewYZXBgbMXenO369rLsdWNNFySdzxm0j1EktrVf9N9CAYyCnTlzGRGZ4zUb3qVTastVg8TCwaaM6la4mRX0vx3qQc0U5ohe03p4ow-5XsGeVqiD2t4yj6knp3RD1xb4lYLIkcQ37RxwVZaDpIWmyH8g Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:21:03.965632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b8799a08d0684b5c8d9cd3f89c3016d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b8799a08d0684b5c8d9cd3f89c3016d7"}]}] Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 3d931a379404433b9c3c690dd9beb83d Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:03.967795 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'e798b2fb-1903-448d-b38e-5e8c48dfc9eb'} Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:03.968856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:03.970391 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:03.971937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Returning 404 to user: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:03.971937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0d6e5750-bb1d-453a-8fcf-aab63d4d2171 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 404 len: 111 microversion: 2.20 time: 0.031427 Sep 01 09:21:03.971937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 485/984] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:21:03 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:03.976343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0c991500-2687-43ec-b382-1ecbc0277cf2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '.version_select at 0x7f7a68c51e50>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:04.045323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0c991500-2687-43ec-b382-1ecbc0277cf2 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031958469" status: 204 len: 0 microversion: 2.20 time: 0.072731 Sep 01 09:21:04.045902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 500/985] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Sep 1 09:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031958469 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 09:21:06.084064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:06.084569 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:06.091092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:06.091862 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:06.092331 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:06.093021 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:06.093495 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:06.093902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:06.107396 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] HTTP exception thrown: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Request method failure captured: Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb HTTP/1.1 Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcGlE_ApwWREQ1_FaCCpmJ-ewYZXBgbMXenO369rLsdWNNFySdzxm0j1EktrVf9N9CAYyCnTlzGRGZ4zUb3qVTastVg8TCwaaM6la4mRX0vx3qQc0U5ohe03p4ow-5XsGeVqiD2t4yj6knp3RD1xb4lYLIkcQ37RxwVZaDpIWmyH8g Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:21:06.108934 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b8799a08d0684b5c8d9cd3f89c3016d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b8799a08d0684b5c8d9cd3f89c3016d7"}]}] Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 3d931a379404433b9c3c690dd9beb83d Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.110669 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'e798b2fb-1903-448d-b38e-5e8c48dfc9eb'} Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:06.111647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.113131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.114734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Returning 404 to user: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:06.114734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e294afb3-a6d0-46ab-8c35-1c83541d9517 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 404 len: 111 microversion: 2.20 time: 0.030172 Sep 01 09:21:06.114734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 486/986] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 09:21:06 2022] DELETE /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:06.119661 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:06.121241 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: e798b2fb-1903-448d-b38e-5e8c48dfc9eb] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:06.128065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:06.128555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:06.128994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:06.129679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:06.130166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:06.130595 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:06.146172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] HTTP exception thrown: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Request method failure captured: Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb HTTP/1.1 Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHcGlE_ApwWREQ1_FaCCpmJ-ewYZXBgbMXenO369rLsdWNNFySdzxm0j1EktrVf9N9CAYyCnTlzGRGZ4zUb3qVTastVg8TCwaaM6la4mRX0vx3qQc0U5ohe03p4ow-5XsGeVqiD2t4yj6knp3RD1xb4lYLIkcQ37RxwVZaDpIWmyH8g Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:21:06.147903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b8799a08d0684b5c8d9cd3f89c3016d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b8799a08d0684b5c8d9cd3f89c3016d7"}]}] Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 3d931a379404433b9c3c690dd9beb83d Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.149546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'e798b2fb-1903-448d-b38e-5e8c48dfc9eb'} Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:06.150807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. Sep 01 09:21:06.152483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:06.153953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Returning 404 to user: Instance e798b2fb-1903-448d-b38e-5e8c48dfc9eb could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:06.153953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-edab1878-5052-43ea-ad0f-abb7281bb1e0 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb" status: 404 len: 111 microversion: 2.20 time: 0.034265 Sep 01 09:21:06.153953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 501/987] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:21:06 2022] GET /compute/v2.1/servers/e798b2fb-1903-448d-b38e-5e8c48dfc9eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:07.443894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:07.444418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:07.452142 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:07.452634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:07.453075 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:07.453776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:07.454233 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:07.454661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:07.469390 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] HTTP exception thrown: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Request method failure captured: Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d HTTP/1.1 Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHcGlE_ApwWREQ1_FaCCpmJ-ewYZXBgbMXenO369rLsdWNNFySdzxm0j1EktrVf9N9CAYyCnTlzGRGZ4zUb3qVTastVg8TCwaaM6la4mRX0vx3qQc0U5ohe03p4ow-5XsGeVqiD2t4yj6knp3RD1xb4lYLIkcQ37RxwVZaDpIWmyH8g Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:21:07.471040 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b8799a08d0684b5c8d9cd3f89c3016d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b8799a08d0684b5c8d9cd3f89c3016d7"}]}] Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 3d931a379404433b9c3c690dd9beb83d Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.472777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '2cfa76cf-89f5-4112-a5ae-859e051bbe0d'} Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:07.473700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.475367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.481339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Returning 404 to user: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:07.481339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-86eaddd5-068a-4c6e-b469-d8e7f0c44d9d tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 404 len: 111 microversion: 2.20 time: 0.032535 Sep 01 09:21:07.481339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 487/988] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Sep 1 09:21:07 2022] DELETE /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:07.482577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:07.483233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] [instance: 2cfa76cf-89f5-4112-a5ae-859e051bbe0d] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:21:07.489639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:07.490121 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:07.490554 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:07.491266 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:21:07.491765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:21:07.492189 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:21:07.505992 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] HTTP exception thrown: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Request method failure captured: Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d HTTP/1.1 Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHcGlE_ApwWREQ1_FaCCpmJ-ewYZXBgbMXenO369rLsdWNNFySdzxm0j1EktrVf9N9CAYyCnTlzGRGZ4zUb3qVTastVg8TCwaaM6la4mRX0vx3qQc0U5ohe03p4ow-5XsGeVqiD2t4yj6knp3RD1xb4lYLIkcQ37RxwVZaDpIWmyH8g Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:21:07.513090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b8799a08d0684b5c8d9cd3f89c3016d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b8799a08d0684b5c8d9cd3f89c3016d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b8799a08d0684b5c8d9cd3f89c3016d7"}]}] Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: b8799a08d0684b5c8d9cd3f89c3016d7 Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1435946677 Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 3d931a379404433b9c3c690dd9beb83d Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1435946677-project Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.514822 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '2cfa76cf-89f5-4112-a5ae-859e051bbe0d'} Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:07.516216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. Sep 01 09:21:07.517664 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:07.519070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] Returning 404 to user: Instance 2cfa76cf-89f5-4112-a5ae-859e051bbe0d could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:07.519070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5b91f2f1-4be7-489b-8352-1df1d4ccca80 tempest-AttachVolumeShelveTestJSON-1435946677 tempest-AttachVolumeShelveTestJSON-1435946677-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d" status: 404 len: 111 microversion: 2.20 time: 0.031728 Sep 01 09:21:07.519070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 502/989] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Sep 1 09:21:07 2022] GET /compute/v2.1/servers/2cfa76cf-89f5-4112-a5ae-859e051bbe0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:13.079277 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b0797a7b-513f-4f38-816b-39f6e07b678c tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Action: 'create', calling method: .version_select at 0x7f7a654cd160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-713447816", "metadata": {"Type": "work"}}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b0797a7b-513f-4f38-816b-39f6e07b678c tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Request method failure captured: Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 121 Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHmIPkkwbaZv3deYA_pSRFAi0ji_As0G_dbJCv5XjHxXXpVtCE1Igg1hrGJGI1iVk6qt7vrzIPFQF2ecmYs4_9f4-V_bRtAcEPjZXOTOO3C3ay4I8eObZ_lLjFKw1J2goOw99MUeMMteEDFhWMkZc1ycygIstA7mcSvYEQ8H_uc-6yY Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:21:13.102451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_586913e10e634fbbabbf164847c75632", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/586913e10e634fbbabbf164847c75632"}]}] Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: b6c18954d41e4c96aaf2f58e5515687c Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-713447816", "metadata": {"Type": "work"}}} Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: Sep 01 09:21:13.104066 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-713447816', 'metadata': {'Type': 'work'}}}} Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise error Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:13.105026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 09:21:13.106759 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 09:21:13.109013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 09:21:13.109013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.109013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b0797a7b-513f-4f38-816b-39f6e07b678c tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:13.109013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b0797a7b-513f-4f38-816b-39f6e07b678c tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137600 Sep 01 09:21:13.109013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 488/990] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 09:21:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:13.114716 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5ffc8973-89f4-4c56-8901-7af6ebd9e7ea tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Action: 'create', calling method: .version_select at 0x7f7a68c9edc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-171015068", "metadata": {"Type": "work"}}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5ffc8973-89f4-4c56-8901-7af6ebd9e7ea tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Request method failure captured: Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 119 Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHmIPkkwbaZv3deYA_pSRFAi0ji_As0G_dbJCv5XjHxXXpVtCE1Igg1hrGJGI1iVk6qt7vrzIPFQF2ecmYs4_9f4-V_bRtAcEPjZXOTOO3C3ay4I8eObZ_lLjFKw1J2goOw99MUeMMteEDFhWMkZc1ycygIstA7mcSvYEQ8H_uc-6yY Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:21:13.119167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_586913e10e634fbbabbf164847c75632", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/586913e10e634fbbabbf164847c75632"}]}] Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: b6c18954d41e4c96aaf2f58e5515687c Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-171015068", "metadata": {"Type": "work"}}} Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: Sep 01 09:21:13.125113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-171015068', 'metadata': {'Type': 'work'}}}} Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise error Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi '0' Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:13.127026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 09:21:13.128668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 09:21:13.130068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 09:21:13.130068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.130068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5ffc8973-89f4-4c56-8901-7af6ebd9e7ea tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:13.130068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5ffc8973-89f4-4c56-8901-7af6ebd9e7ea tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009722 Sep 01 09:21:13.130068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 503/991] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 09:21:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:13.131804 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3e02b6db-6ff4-4426-b61e-81fc3f35ffde tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Action: 'create', calling method: .version_select at 0x7f7a652e7310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1134364190", "metadata": {"Type": "work"}}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3e02b6db-6ff4-4426-b61e-81fc3f35ffde tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Request method failure captured: Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 119 Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHmIPkkwbaZv3deYA_pSRFAi0ji_As0G_dbJCv5XjHxXXpVtCE1Igg1hrGJGI1iVk6qt7vrzIPFQF2ecmYs4_9f4-V_bRtAcEPjZXOTOO3C3ay4I8eObZ_lLjFKw1J2goOw99MUeMMteEDFhWMkZc1ycygIstA7mcSvYEQ8H_uc-6yY Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:21:13.136327 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_586913e10e634fbbabbf164847c75632", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/586913e10e634fbbabbf164847c75632"}]}] Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: b6c18954d41e4c96aaf2f58e5515687c Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1134364190", "metadata": {"Type": "work"}}} Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: Sep 01 09:21:13.137847 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1134364190', 'metadata': {'Type': 'work'}}}} Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise error Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi '' Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:13.138879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 09:21:13.140774 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 09:21:13.142947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 09:21:13.142947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.142947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3e02b6db-6ff4-4426-b61e-81fc3f35ffde tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:13.142947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3e02b6db-6ff4-4426-b61e-81fc3f35ffde tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009717 Sep 01 09:21:13.142947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 489/992] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Sep 1 09:21:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 09:21:13.147019 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-41365d18-cd78-4137-9ae7-309f81e83300 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Calling method '.version_select at 0x7f7a656b3820>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:13.177879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-41365d18-cd78-4137-9ae7-309f81e83300 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] HTTP exception thrown: Volume tempest-invalid-717219822 could not be found. Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-41365d18-cd78-4137-9ae7-309f81e83300 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Request method failure captured: Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-717219822 HTTP/1.1 Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHmIPkkwbaZv3deYA_pSRFAi0ji_As0G_dbJCv5XjHxXXpVtCE1Igg1hrGJGI1iVk6qt7vrzIPFQF2ecmYs4_9f4-V_bRtAcEPjZXOTOO3C3ay4I8eObZ_lLjFKw1J2goOw99MUeMMteEDFhWMkZc1ycygIstA7mcSvYEQ8H_uc-6yY Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:21:13.179857 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_586913e10e634fbbabbf164847c75632", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/586913e10e634fbbabbf164847c75632"}]}] Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: b6c18954d41e4c96aaf2f58e5515687c Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Volume tempest-invalid-717219822 could not be found. Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'tempest-invalid-717219822'} Sep 01 09:21:13.181256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-717219822 could not be found. (HTTP 404) (Request-ID: req-3bf5451f-17e7-49e1-b580-69705b41762a) Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.182045 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 09:21:13.183253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-717219822 could not be found. Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:13.184432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-717219822 could not be found. Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-717219822 could not be found. Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-41365d18-cd78-4137-9ae7-309f81e83300 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Returning 404 to user: Volume tempest-invalid-717219822 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-41365d18-cd78-4137-9ae7-309f81e83300 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-717219822" status: 404 len: 98 microversion: 2.1 time: 0.038227 Sep 01 09:21:13.185811 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 504/993] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Sep 1 09:21:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-717219822 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 01 09:21:13.191003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-670b4d19-e80d-4d94-9581-99b36e237226 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003853 Sep 01 09:21:13.191544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 490/994] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Sep 1 09:21:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 09:21:13.199774 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-40e3e639-1a97-475b-a417-6ebbdb6c7294 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003817 Sep 01 09:21:13.200321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 505/995] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Sep 1 09:21:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 09:21:13.208431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b54be40d-803b-498f-8f11-ae09cf89b974 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Calling method '.version_select at 0x7f7a654cd8b0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:13.237907 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-b54be40d-803b-498f-8f11-ae09cf89b974 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] HTTP exception thrown: Volume b9ca9d93-8718-444e-b727-192a91930649 could not be found. Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b54be40d-803b-498f-8f11-ae09cf89b974 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Request method failure captured: Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: DELETE /compute/v2.1/os-volumes/b9ca9d93-8718-444e-b727-192a91930649 HTTP/1.1 Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHmIPkkwbaZv3deYA_pSRFAi0ji_As0G_dbJCv5XjHxXXpVtCE1Igg1hrGJGI1iVk6qt7vrzIPFQF2ecmYs4_9f4-V_bRtAcEPjZXOTOO3C3ay4I8eObZ_lLjFKw1J2goOw99MUeMMteEDFhWMkZc1ycygIstA7mcSvYEQ8H_uc-6yY Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:21:13.240031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_586913e10e634fbbabbf164847c75632", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/586913e10e634fbbabbf164847c75632"}]}] Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: b6c18954d41e4c96aaf2f58e5515687c Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Volume b9ca9d93-8718-444e-b727-192a91930649 could not be found. Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'b9ca9d93-8718-444e-b727-192a91930649'} Sep 01 09:21:13.241610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9ca9d93-8718-444e-b727-192a91930649 could not be found. (HTTP 404) (Request-ID: req-49efed2e-4a39-4816-9a73-033ff03eaf8d) Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.243385 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 09:21:13.244761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9ca9d93-8718-444e-b727-192a91930649 could not be found. Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 09:21:13.245913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9ca9d93-8718-444e-b727-192a91930649 could not be found. Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9ca9d93-8718-444e-b727-192a91930649 could not be found. Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-b54be40d-803b-498f-8f11-ae09cf89b974 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Returning 404 to user: Volume b9ca9d93-8718-444e-b727-192a91930649 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-b54be40d-803b-498f-8f11-ae09cf89b974 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/b9ca9d93-8718-444e-b727-192a91930649" status: 404 len: 109 microversion: 2.1 time: 0.036567 Sep 01 09:21:13.247856 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 491/996] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Sep 1 09:21:13 2022] DELETE /compute/v2.1/os-volumes/b9ca9d93-8718-444e-b727-192a91930649 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:21:13.251429 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64891e4c-6829-4f4b-b798-991c5ba61fc0 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Calling method '.version_select at 0x7f7a68c51dc0>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:21:13.278445 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-64891e4c-6829-4f4b-b798-991c5ba61fc0 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] HTTP exception thrown: Volume e0029b92-3028-4e0e-976a-a6de83f5edf5 could not be found. Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64891e4c-6829-4f4b-b798-991c5ba61fc0 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Request method failure captured: Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/os-volumes/e0029b92-3028-4e0e-976a-a6de83f5edf5 HTTP/1.1 Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHmIPkkwbaZv3deYA_pSRFAi0ji_As0G_dbJCv5XjHxXXpVtCE1Igg1hrGJGI1iVk6qt7vrzIPFQF2ecmYs4_9f4-V_bRtAcEPjZXOTOO3C3ay4I8eObZ_lLjFKw1J2goOw99MUeMMteEDFhWMkZc1ycygIstA7mcSvYEQ8H_uc-6yY Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:21:13.280914 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_586913e10e634fbbabbf164847c75632", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/586913e10e634fbbabbf164847c75632"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/586913e10e634fbbabbf164847c75632"}]}] Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 586913e10e634fbbabbf164847c75632 Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesNegativeTest-2002711004 Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: b6c18954d41e4c96aaf2f58e5515687c Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesNegativeTest-2002711004-project Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Volume e0029b92-3028-4e0e-976a-a6de83f5edf5 could not be found. Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'e0029b92-3028-4e0e-976a-a6de83f5edf5'} Sep 01 09:21:13.282530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0029b92-3028-4e0e-976a-a6de83f5edf5 could not be found. (HTTP 404) (Request-ID: req-ad97290d-abde-4115-82eb-b650160dec70) Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.283682 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 09:21:13.285092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0029b92-3028-4e0e-976a-a6de83f5edf5 could not be found. Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 09:21:13.286785 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e0029b92-3028-4e0e-976a-a6de83f5edf5 could not be found. Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0029b92-3028-4e0e-976a-a6de83f5edf5 could not be found. Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64891e4c-6829-4f4b-b798-991c5ba61fc0 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] Returning 404 to user: Volume e0029b92-3028-4e0e-976a-a6de83f5edf5 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64891e4c-6829-4f4b-b798-991c5ba61fc0 tempest-VolumesNegativeTest-2002711004 tempest-VolumesNegativeTest-2002711004-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e0029b92-3028-4e0e-976a-a6de83f5edf5" status: 404 len: 109 microversion: 2.1 time: 0.034796 Sep 01 09:21:13.288255 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 506/997] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Sep 1 09:21:13 2022] GET /compute/v2.1/os-volumes/e0029b92-3028-4e0e-976a-a6de83f5edf5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:22:34.299241 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=16 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:22:34.300211 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=32 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:22:34.305545 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1411846491", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "networks": [{"uuid": "0c253612-646d-4380-bd84-fabd691df3e3"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:22:34.358660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] validate_networks() for [('0c253612-646d-4380-bd84-fabd691df3e3', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:22:34.716800 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:22:34.721829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:22:34.721829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:22:34.721829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:22:34.721829 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:22:34.727572 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:34.728055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:34.728491 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:34.729213 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:34.729668 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:34.730094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:34.747120 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Getting quotas for project 8c703a441ccd4fd6aed56096783f1086. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:22:34.751160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Getting quotas for user 7538ff30b3ff42a784da0336012f901d and project 8c703a441ccd4fd6aed56096783f1086. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:22:34.762796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:22:34.765153 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:22:34.885921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ba9d7e28-af38-4f80-818a-2234146fb1da tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588617 Sep 01 09:22:34.886577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 492/998] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:22:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:22:34.896302 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:22:34.897162 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:22:34.899165 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:22:34.904050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Thu Sep 1 09:22:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 (ip 10.222.0.46) !!! Sep 01 09:22:34.904419 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3d3e54c3-8968-4b46-9076-bda2cb8beb90 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:34.905073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3d3e54c3-8968-4b46-9076-bda2cb8beb90 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:34.963324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3d3e54c3-8968-4b46-9076-bda2cb8beb90 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:34.972691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3d3e54c3-8968-4b46-9076-bda2cb8beb90 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1219 microversion: 2.1 time: 0.078974 Sep 01 09:22:34.979095 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 507/999] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:34 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:35.993436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:35.994046 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:36.001406 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:36.002082 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:36.003065 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:36.004022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:36.004479 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:36.004907 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:36.067200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:36.075007 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5ebbe446-f4b6-43ff-b2e1-34115f6f186d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1223 microversion: 2.1 time: 0.085751 Sep 01 09:22:36.075859 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 493/1000] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:35 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:37.101877 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:37.102531 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:37.111567 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:37.113934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:37.113934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:37.114627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:37.115310 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:37.115956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:37.200233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:37.210271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-364e5778-758d-494d-a4dc-f27556519605 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1279 microversion: 2.1 time: 0.116589 Sep 01 09:22:37.210873 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 508/1001] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:37 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:38.231526 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:38.232737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:38.239506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:38.240413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:38.240861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:38.241614 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:38.242160 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:38.242751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:38.381634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:38.390734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-cc316004-f64d-4496-b980-b360f5f10e23 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.163066 Sep 01 09:22:38.391535 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 494/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:38 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:38.907913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-7bef865e-7a0e-42df-8282-a5d3fd341f52 req-866abbc3-bab5-41e3-a473-a8d3d6526b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad39c80f-b53d-480b-a19e-2bf2675ac947", "tag": "e4083a73-4ed9-49b1-a7ae-8de0a8311723"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:22:38.921751 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-7bef865e-7a0e-42df-8282-a5d3fd341f52 req-866abbc3-bab5-41e3-a473-a8d3d6526b7c service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:38.922618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-7bef865e-7a0e-42df-8282-a5d3fd341f52 req-866abbc3-bab5-41e3-a473-a8d3d6526b7c service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:38.923059 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-7bef865e-7a0e-42df-8282-a5d3fd341f52 req-866abbc3-bab5-41e3-a473-a8d3d6526b7c service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:38.935724 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-7bef865e-7a0e-42df-8282-a5d3fd341f52 req-866abbc3-bab5-41e3-a473-a8d3d6526b7c service nova] Creating event network-changed:e4083a73-4ed9-49b1-a7ae-8de0a8311723 for instance ad39c80f-b53d-480b-a19e-2bf2675ac947 on hv-cinder-82002 Sep 01 09:22:38.943200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-7bef865e-7a0e-42df-8282-a5d3fd341f52 req-866abbc3-bab5-41e3-a473-a8d3d6526b7c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039866 Sep 01 09:22:38.943874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 509/1003] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:22:39.411991 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:39.412615 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:39.419190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:39.419673 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:39.420100 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:39.420789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:39.421240 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:39.421674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:39.567557 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:39.577796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-128282ea-b2bf-46a6-84ef-0b935bb5d9bf tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.169796 Sep 01 09:22:39.578492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 495/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:39 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:40.599892 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:40.600595 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:40.607008 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:40.607555 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:40.608010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:40.608677 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:40.609135 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:40.609559 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:40.741732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:40.749317 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-de2062c2-61ce-42fd-b839-ed051de995a6 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.154975 Sep 01 09:22:40.749884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 510/1005] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:40 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:41.771206 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:41.771788 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:41.778242 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:41.778730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:41.779208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:41.779929 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:41.780387 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:41.780817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:41.907794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:41.916614 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d947136b-4106-41dc-ac83-1b918de7557c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.149859 Sep 01 09:22:41.917189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 496/1006] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:41 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:42.936938 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:42.937602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:42.943866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:42.944344 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:42.944776 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:42.945462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:42.945916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:42.946345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:43.073515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:43.081097 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-af4b1f2f-b357-4686-b054-67081075bb97 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.147981 Sep 01 09:22:43.082173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 511/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:42 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:44.102816 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:44.103490 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:44.109624 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:44.110108 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:44.110548 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:44.111278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:44.111737 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:44.112161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:44.244744 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:44.252555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7fd0cc1e-9333-4913-a4a9-581ac26f3a7b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.153757 Sep 01 09:22:44.253138 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 497/1008] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:44 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:45.272901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:45.273516 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:45.276020 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:22:45.280766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:45.281253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:45.281692 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:45.282378 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:45.282834 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:45.283326 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:45.568686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:45.576530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d40984e2-2629-4eec-a88b-08b82ec0e23d tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.307806 Sep 01 09:22:45.577092 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 512/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:45 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:46.598337 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:46.598944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:46.600796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:22:46.601827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:22:46.606683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:46.607196 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:46.607632 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:46.608313 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:46.608770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:46.609191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:46.744739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:46.752435 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-03ec4b2c-ae1e-46c4-bdfb-06518f62fb11 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.158553 Sep 01 09:22:46.753009 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 498/1010] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:46 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:47.772353 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:47.772959 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:47.779324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:47.787911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:47.787911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:47.787911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:47.787911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:47.788313 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:47.912003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:47.920459 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2738d230-7740-4361-aaa7-cc94ce3c0371 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.151984 Sep 01 09:22:47.921027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 513/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:47 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:48.042448 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-10f8746f-a399-4718-a7c3-fff52d50dd0f req-62091f72-03e3-4d1a-ab71-28b6fef4a411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad39c80f-b53d-480b-a19e-2bf2675ac947", "name": "network-vif-plugged", "status": "completed", "tag": "e4083a73-4ed9-49b1-a7ae-8de0a8311723"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:22:48.052734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-10f8746f-a399-4718-a7c3-fff52d50dd0f req-62091f72-03e3-4d1a-ab71-28b6fef4a411 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:48.053221 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-10f8746f-a399-4718-a7c3-fff52d50dd0f req-62091f72-03e3-4d1a-ab71-28b6fef4a411 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:48.053655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-10f8746f-a399-4718-a7c3-fff52d50dd0f req-62091f72-03e3-4d1a-ab71-28b6fef4a411 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:48.064612 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-10f8746f-a399-4718-a7c3-fff52d50dd0f req-62091f72-03e3-4d1a-ab71-28b6fef4a411 service nova] Creating event network-vif-plugged:e4083a73-4ed9-49b1-a7ae-8de0a8311723 for instance ad39c80f-b53d-480b-a19e-2bf2675ac947 on hv-cinder-82002 Sep 01 09:22:48.069983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-10f8746f-a399-4718-a7c3-fff52d50dd0f req-62091f72-03e3-4d1a-ab71-28b6fef4a411 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162288 Sep 01 09:22:48.070566 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 499/1012] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:22:48.942525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:48.952253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:48.952253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:48.952253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:48.952253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:48.952686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:48.952686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:48.952686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:49.082003 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:49.090668 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-72ac1cb9-ea99-42b1-bcad-e550c9cedc3b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1319 microversion: 2.1 time: 0.152627 Sep 01 09:22:49.091250 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 514/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:48 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:22:50.111682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:22:50.112308 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:22:50.119744 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:50.120236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:50.120707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:50.121413 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:22:50.121868 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:22:50.122293 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:22:50.261697 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:22:50.270039 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-29f7eacb-51e7-438d-ad46-705d2895dde2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1506 microversion: 2.1 time: 0.163267 Sep 01 09:22:50.270610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 500/1014] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:22:50 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:03.139477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=18 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:03.140973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=38 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:03.325269 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0127b2f6-0e22-4dae-b3d3-f7ad92427fde tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Action: 'create', calling method: .version_select at 0x7f7a68c560d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1795981516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgCrhLOi2Fgp/no71KlwSo/BfMx8lPfemFufLZ9oZqNbupKc6nfPI0T0T6ubNqZI1oM3+fGiRyJEDLlPY7meJ8tJ6GynP681TTLXRQm+XgUW5Pl/tM/PAyyUKR7P2DjUQ=="}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:23:03.342303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-0127b2f6-0e22-4dae-b3d3-f7ad92427fde tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Getting quotas for project 049e76e29a48415681a0047f72bb9e8c. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:23:03.347643 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-0127b2f6-0e22-4dae-b3d3-f7ad92427fde tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Getting quotas for user 702cf20256a74edcad54abbc464cb099 and project 049e76e29a48415681a0047f72bb9e8c. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:23:03.438231 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0127b2f6-0e22-4dae-b3d3-f7ad92427fde tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.303698 Sep 01 09:23:03.438843 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 515/1015] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:23:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:23:13.317257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef7fe44-fad6-433b-a635-ceffb5b8b38c", "device": "/dev/sdb"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:23:13.320420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:13.323089 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:13.323773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=46 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:13.328528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:13.329016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:13.329451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:13.330655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:13.331364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:13.332093 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:14.066375 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e563b8d9-5468-4f54-8fe1-7a6eacdc9dd0 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "POST /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753108 Sep 01 09:23:14.066996 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 501/1016] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:23:13 2022] POST /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947/os-volume_attachments => generated 194 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:23:43.679918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=4 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:43.680676 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:43.684801 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1013982042", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1795981516", "security_groups": [{"name": "tempest-secgroup-smoke-1294360660"}], "networks": [{"uuid": "d647c673-24bb-450c-a61b-5d54feaffef9"}], "block_device_mapping_v2": [{"uuid": "6b27fea3-7cd8-4453-abe4-ad944340509d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:23:43.799869 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] validate_networks() for [('d647c673-24bb-450c-a61b-5d54feaffef9', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:23:44.264401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:23:44.264821 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:23:44.265294 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:23:44.265798 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:23:44.266207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:23:44.274859 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:44.275364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:44.275794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:44.276627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:44.277144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:44.277436 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:44.294011 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Getting quotas for project 049e76e29a48415681a0047f72bb9e8c. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:23:44.297911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Getting quotas for user 702cf20256a74edcad54abbc464cb099 and project 049e76e29a48415681a0047f72bb9e8c. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:23:44.353283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:23:44.356103 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b27fea3-7cd8-4453-abe4-ad944340509d',volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:23:44.789119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-218c8339-a083-4777-9d16-29e508c4f46f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.110785 Sep 01 09:23:44.792435 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 516/1017] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:23:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:23:44.798657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:44.799574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:44.804504 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ed81be94-949c-4358-80e1-705b32884303 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:44.806056 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ed81be94-949c-4358-80e1-705b32884303 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:44.860937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ed81be94-949c-4358-80e1-705b32884303 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:44.868094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ed81be94-949c-4358-80e1-705b32884303 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1089 microversion: 2.1 time: 0.070888 Sep 01 09:23:44.868680 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 502/1018] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:44 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:45.889412 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:45.890025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:45.896166 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:45.896650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:45.897089 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:45.897778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:45.898235 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:45.898659 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:45.960189 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:45.969111 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6c8c1e4d-6b99-4b63-b8de-9c9dbaf55652 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1139 microversion: 2.1 time: 0.084526 Sep 01 09:23:45.973087 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 517/1019] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:45 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:46.858628 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:46.859187 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:46.866891 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:46.867421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:46.867883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:46.868569 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:46.869024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:46.869453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:46.972641 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lazy-loading 'services' on Instance uuid ad39c80f-b53d-480b-a19e-2bf2675ac947 {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:23:46.992804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:46.993594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:47.003361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:47.003361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:47.003361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:47.003361 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:47.004293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:47.004293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:47.111256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:47.119158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-88befbce-3346-4fbf-8e93-fa4926d2e35f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1195 microversion: 2.1 time: 0.131626 Sep 01 09:23:47.119732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 518/1020] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:46 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1195 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:23:47.197112 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a35d81a3-43a0-49f8-8fec-e4e2002055ac tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947/os-volume_attachments/7ef7fe44-fad6-433b-a635-ceffb5b8b38c" status: 202 len: 0 microversion: 2.1 time: 0.343409 Sep 01 09:23:47.197812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 503/1021] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:23:46 2022] DELETE /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947/os-volume_attachments/7ef7fe44-fad6-433b-a635-ceffb5b8b38c => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:23:48.141504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:48.142035 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:48.149579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:48.150384 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:48.150833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:48.151535 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:48.152597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:48.153311 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:48.323847 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:48.332109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b730ed32-6b74-458d-aa72-060d0ecfc660 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1273 microversion: 2.1 time: 0.194685 Sep 01 09:23:48.332642 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 519/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:48 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:48.647766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-497a83c4-ba00-4794-b6ef-0b9073a472dd req-25e5d969-83b0-4604-aec6-2fc98540755f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceaf1c5-17c1-4a73-88e6-7a4d5a93874a", "tag": "6abbc346-39c9-491e-96b8-0d36e5f1263e"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:23:48.658650 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-497a83c4-ba00-4794-b6ef-0b9073a472dd req-25e5d969-83b0-4604-aec6-2fc98540755f service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:48.659449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-497a83c4-ba00-4794-b6ef-0b9073a472dd req-25e5d969-83b0-4604-aec6-2fc98540755f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:48.678529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-497a83c4-ba00-4794-b6ef-0b9073a472dd req-25e5d969-83b0-4604-aec6-2fc98540755f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:48.678529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-497a83c4-ba00-4794-b6ef-0b9073a472dd req-25e5d969-83b0-4604-aec6-2fc98540755f service nova] Creating event network-changed:6abbc346-39c9-491e-96b8-0d36e5f1263e for instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a on hv-cinder-82002 Sep 01 09:23:48.678529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-497a83c4-ba00-4794-b6ef-0b9073a472dd req-25e5d969-83b0-4604-aec6-2fc98540755f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035060 Sep 01 09:23:48.678983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 504/1023] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:23:49.353551 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:49.356693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:49.364563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:49.365056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:49.365676 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:49.366180 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:49.368714 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:49.369155 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:49.557193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:49.558579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c5ff50f4-6aa8-4d22-9463-def5ddfe7964 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.209125 Sep 01 09:23:49.559171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 520/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:49 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:50.445600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:50.446182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:50.452438 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:50.452921 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:50.453355 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:50.454039 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:50.454492 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:50.454923 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:50.479784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:23:50.579889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:50.580497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:50.587325 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:50.587816 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:50.588290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:50.589086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:50.590371 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:50.590980 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:50.717787 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c558b54a-d17e-44d6-aaf4-85d044281732 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 204 len: 0 microversion: 2.1 time: 0.276589 Sep 01 09:23:50.718568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 505/1025] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:23:50 2022] DELETE /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:23:50.726808 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:50.727611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:50.728361 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:50.734421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:50.734603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3b2923b3-ae35-4eaf-8061-aa46a56f66eb tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.158679 Sep 01 09:23:50.734915 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:50.735349 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 521/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:50 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:50.735486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:50.736068 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:50.736532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:50.737012 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:50.868267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:50.876512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-eb4256b4-7506-49e2-9382-c29958a90fe2 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1512 microversion: 2.1 time: 0.153432 Sep 01 09:23:50.878104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 506/1027] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:50 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:23:51.755041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:51.755689 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:51.762036 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:51.762524 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:51.762967 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:51.763955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:51.764446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:51.764879 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:51.897585 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:51.897794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:51.898445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:51.905408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:51.905886 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:51.906102 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-05594827-977a-4b05-aa93-7c7ba826ac8d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.154908 Sep 01 09:23:51.906319 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:51.906670 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 522/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:51 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:51.907014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:51.907561 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:51.907994 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:52.037785 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:52.045945 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7113862f-161e-4552-b6fc-fd5c95151dba tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1512 microversion: 2.1 time: 0.152030 Sep 01 09:23:52.046522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 507/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:51 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:23:52.926372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:52.928981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:52.933564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:52.934041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:52.934495 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:52.935994 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:52.936451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:52.936874 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:53.078146 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:53.078803 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:53.086074 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:53.089398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:53.089398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:53.089398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:53.089398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:53.089755 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:53.121012 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:53.129401 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c6b07f19-7360-4a10-b363-f08f4f91ab83 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.206889 Sep 01 09:23:53.130129 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 523/1030] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:52 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:53.134603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-60af6452-ae9c-472d-98aa-6f5081004577 req-13179443-fca5-4c4a-8a5c-e4b410ece919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad39c80f-b53d-480b-a19e-2bf2675ac947", "name": "network-vif-deleted", "tag": "e4083a73-4ed9-49b1-a7ae-8de0a8311723"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:23:53.145766 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-60af6452-ae9c-472d-98aa-6f5081004577 req-13179443-fca5-4c4a-8a5c-e4b410ece919 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:53.152498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-60af6452-ae9c-472d-98aa-6f5081004577 req-13179443-fca5-4c4a-8a5c-e4b410ece919 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:53.152498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-60af6452-ae9c-472d-98aa-6f5081004577 req-13179443-fca5-4c4a-8a5c-e4b410ece919 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:53.154791 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:53.158007 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-60af6452-ae9c-472d-98aa-6f5081004577 req-13179443-fca5-4c4a-8a5c-e4b410ece919 service nova] Creating event network-vif-deleted:e4083a73-4ed9-49b1-a7ae-8de0a8311723 for instance ad39c80f-b53d-480b-a19e-2bf2675ac947 on hv-cinder-82002 Sep 01 09:23:53.162937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-c7a23e87-d50f-43ac-a9f9-fce7ad3e4c50 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 200 len: 1470 microversion: 2.1 time: 0.098636 Sep 01 09:23:53.163497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 508/1031] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:53 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 1470 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:53.164154 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-60af6452-ae9c-472d-98aa-6f5081004577 req-13179443-fca5-4c4a-8a5c-e4b410ece919 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 Sep 01 09:23:53.164753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 524/1032] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:23:54.151069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:54.151636 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:54.158402 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:54.161061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:54.161061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:54.161061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:54.161061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:54.161488 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:54.187322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:54.188031 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: ad39c80f-b53d-480b-a19e-2bf2675ac947] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:54.194973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:54.195665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:54.196116 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:54.197038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:54.197497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:54.197947 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:54.213769 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] HTTP exception thrown: Instance ad39c80f-b53d-480b-a19e-2bf2675ac947 could not be found. Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Request method failure captured: Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 HTTP/1.1 Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHnYjhDX9ROt8S1Bu8LbjAOh7q7MGwMxt75mIQ-IMGMdI6ffwy96G9BKul3hnE_lwG-RF-Fpy8OTQbo8AFbjlOHFE5-aHfGLKNZvTs4J8SY7OnmKfCK8j1NE8FA6V2ChPuHKuDrz48MjQTi-9XGUvaexGRDijUmkS0P77GUUNHupJgY Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 8c703a441ccd4fd6aed56096783f1086 Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1209686020 Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:23:54.215539 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c703a441ccd4fd6aed56096783f1086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8c703a441ccd4fd6aed56096783f1086", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c703a441ccd4fd6aed56096783f1086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8c703a441ccd4fd6aed56096783f1086"}]}] Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-VolumesSnapshotTestJSON-1209686020 Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 8c703a441ccd4fd6aed56096783f1086 Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1209686020 Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-VolumesSnapshotTestJSON-1209686020-project Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 7538ff30b3ff42a784da0336012f901d Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-VolumesSnapshotTestJSON-1209686020-project Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance ad39c80f-b53d-480b-a19e-2bf2675ac947 could not be found. Sep 01 09:23:54.217358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': 'ad39c80f-b53d-480b-a19e-2bf2675ac947'} Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad39c80f-b53d-480b-a19e-2bf2675ac947 could not be found. Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:23:54.218301 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad39c80f-b53d-480b-a19e-2bf2675ac947 could not be found. Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad39c80f-b53d-480b-a19e-2bf2675ac947 could not be found. Sep 01 09:23:54.219678 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:23:54.220956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Returning 404 to user: Instance ad39c80f-b53d-480b-a19e-2bf2675ac947 could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:23:54.220956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c17ea442-5d1e-43d8-953b-b41d462a7271 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947" status: 404 len: 111 microversion: 2.1 time: 0.035714 Sep 01 09:23:54.220956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 525/1033] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:54 2022] GET /compute/v2.1/servers/ad39c80f-b53d-480b-a19e-2bf2675ac947 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:23:54.304143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:54.313035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-88ed7fae-48cc-449b-8521-7b74424aaaff tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.166012 Sep 01 09:23:54.318125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 509/1034] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:54 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:55.334280 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:55.334890 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:55.336846 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:55.337544 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:55.343667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:55.344415 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:55.344608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:55.345293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:55.345747 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:55.346170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:55.474778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:55.482338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-72c223d3-8cf8-4759-973f-646b80c8a3d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.152241 Sep 01 09:23:55.482906 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 526/1035] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:55 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:56.503283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:56.503894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:56.505892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:23:56.511217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:56.511697 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:56.512130 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:56.512814 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:56.513460 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:56.514027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:56.645995 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:56.653623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7c545368-10e7-4020-8491-3ec3f4dddec4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.154240 Sep 01 09:23:56.654874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 510/1036] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:56 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:57.674584 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:57.675230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:57.681525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:57.682004 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:57.682437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:57.683175 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:57.683627 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:57.684049 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:57.817644 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:57.825307 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a508c4e6-5980-4b5e-81aa-e9b609173d40 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.154497 Sep 01 09:23:57.826172 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 527/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:57 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:23:58.846685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:23:58.847323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:23:58.853749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:58.854224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:58.854655 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:58.855370 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:23:58.855824 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:23:58.856244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:23:58.992209 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:23:59.000675 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d6412ce0-1ab0-4ad0-ab2b-74c979acbd0d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.158199 Sep 01 09:23:59.001241 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 511/1038] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:23:58 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:00.020925 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:00.021768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:00.028533 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:00.029015 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:00.029449 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:00.030143 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:00.030598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:00.031027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:00.158043 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:00.165712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c73031de-cab4-4c20-b92f-906924493554 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.148594 Sep 01 09:24:00.166330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 528/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:00 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:01.186964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:01.187624 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:01.194138 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:01.194627 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:01.195069 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:01.195796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:01.196254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:01.196689 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:01.331266 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:01.338861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-535a267d-1834-4edc-b732-1ae2e888a98b tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.157014 Sep 01 09:24:01.339475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 512/1040] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:01 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:02.361243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:02.361837 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:02.368321 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:02.368795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:02.369226 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:02.369902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:02.370351 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:02.370773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:02.500805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:02.508399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b9dddf13-127d-499f-b69d-a9806ccd8112 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.151843 Sep 01 09:24:02.508958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 529/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:02 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:03.528904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:03.529542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:03.536033 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:03.536541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:03.536973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:03.537651 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:03.538104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:03.538523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:03.666181 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:03.674461 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-88409089-d7e8-456c-af15-2bbf66e33d68 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.149328 Sep 01 09:24:03.675038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 513/1042] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:03 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:04.695480 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:04.696098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:04.703318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:04.703803 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:04.704247 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:04.704957 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:04.705414 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:04.706096 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:04.836913 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:04.844543 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a7867bb8-e0af-4776-af11-2e2ff6bfa9e3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.152875 Sep 01 09:24:04.845110 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 530/1043] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:04 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:05.250987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-81a4cdd1-d26a-44e5-9201-7e03b2100467 req-48ce3034-8604-48bc-a6e9-bd86c4e047e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceaf1c5-17c1-4a73-88e6-7a4d5a93874a", "name": "network-vif-plugged", "status": "completed", "tag": "6abbc346-39c9-491e-96b8-0d36e5f1263e"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:24:05.260809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-81a4cdd1-d26a-44e5-9201-7e03b2100467 req-48ce3034-8604-48bc-a6e9-bd86c4e047e9 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:05.261283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-81a4cdd1-d26a-44e5-9201-7e03b2100467 req-48ce3034-8604-48bc-a6e9-bd86c4e047e9 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:05.261709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-81a4cdd1-d26a-44e5-9201-7e03b2100467 req-48ce3034-8604-48bc-a6e9-bd86c4e047e9 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:05.272865 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-81a4cdd1-d26a-44e5-9201-7e03b2100467 req-48ce3034-8604-48bc-a6e9-bd86c4e047e9 service nova] Creating event network-vif-plugged:6abbc346-39c9-491e-96b8-0d36e5f1263e for instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a on hv-cinder-82002 Sep 01 09:24:05.277985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-81a4cdd1-d26a-44e5-9201-7e03b2100467 req-48ce3034-8604-48bc-a6e9-bd86c4e047e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Sep 01 09:24:05.278517 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 514/1044] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:24:05.727986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-879826790", "imageRef": "0c056d2d-bb49-4d9f-9544-3994a66d735a", "flavorRef": "452", "networks": [{"uuid": "0c253612-646d-4380-bd84-fabd691df3e3"}]}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:24:05.781422 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.network.neutron [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] validate_networks() for [('0c253612-646d-4380-bd84-fabd691df3e3', None, None, None, None, None)] {{(pid=121062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:24:05.865819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:05.866421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:05.872533 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:05.873020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:05.873475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:05.874167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:05.874619 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:05.875043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:06.017183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:06.025013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-e45b7ff3-89a1-4fc5-a5bb-96dc02516047 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.163559 Sep 01 09:24:06.025598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 515/1045] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:05 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:24:06.128399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Flavor limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:24:06.128825 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Image limits 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:24:06.129299 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Flavor pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:24:06.129707 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Image pref 0:0:0 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:24:06.130120 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.virt.hardware [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:24:06.139854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:06.140340 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:06.140773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:06.141498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:06.141951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:06.142374 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:06.158971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Getting quotas for project 8c703a441ccd4fd6aed56096783f1086. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:24:06.162907 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Getting quotas for user 7538ff30b3ff42a784da0336012f901d and project 8c703a441ccd4fd6aed56096783f1086. Resources: {'cores', 'ram', 'instances'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:24:06.173866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Going to run 1 instances... {{(pid=121062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:24:06.176123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c056d2d-bb49-4d9f-9544-3994a66d735a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:24:06.309386 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-49e446f5-10f1-4c99-a675-77413f932ead tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585153 Sep 01 09:24:06.310031 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 531/1046] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:24:06.321890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3376d447-8101-4c7e-a198-4ff6005c7cce tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:06.322506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3376d447-8101-4c7e-a198-4ff6005c7cce tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:06.378189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3376d447-8101-4c7e-a198-4ff6005c7cce tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:06.385434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3376d447-8101-4c7e-a198-4ff6005c7cce tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1218 microversion: 2.1 time: 0.067404 Sep 01 09:24:06.386506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 516/1047] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:06 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:07.047005 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:07.047688 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:07.054283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:07.056721 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:07.056721 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:07.056721 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:07.056721 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:07.057093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:07.191618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:07.199323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c9849ed0-1493-460c-8228-c358dbf2cce6 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1261 microversion: 2.1 time: 0.157369 Sep 01 09:24:07.199881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 532/1048] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:07 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:07.406431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:07.407071 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:07.414234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:07.414725 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:07.415197 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:07.415894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:07.416356 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:07.416789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:07.477390 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:07.485404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-fc28efcc-750e-4795-af1c-a291591ca0d7 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1222 microversion: 2.1 time: 0.083520 Sep 01 09:24:07.486200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 517/1049] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:07 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:08.221002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:08.225304 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:08.227946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:08.228452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:08.228885 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:08.229560 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:08.230009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:08.230429 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:08.358177 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:08.366577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d2988fed-2c07-47bc-81a8-ba715d78ee6f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1446 microversion: 2.1 time: 0.149929 Sep 01 09:24:08.367165 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 533/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:08 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:08.386610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:08.387171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:08.392983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:08.393457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:08.393889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:08.394569 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:08.395016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:08.395475 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:08.506248 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:08.506960 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:08.513330 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:08.513818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:08.514280 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:08.515072 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:08.515545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:08.515971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:08.585141 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:08.594392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0eff9c32-aa1c-47eb-992a-5425bdd8102b tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1270 microversion: 2.1 time: 0.091985 Sep 01 09:24:08.594987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 534/1051] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:08 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:24:08.778189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:08.786665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-41df5fc6-c6d9-4739-81e7-305c28b241bc tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1446 microversion: 2.1 time: 0.403873 Sep 01 09:24:08.787451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 518/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:08 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1446 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:09.617418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:09.618025 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:09.625497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:09.626202 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:09.626641 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:09.627364 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:09.627818 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:09.628346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:09.632836 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=100 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:09.854112 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:09.862944 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64b33d37-e694-4e0b-8df9-9b7be3eb08f3 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.249369 Sep 01 09:24:09.863888 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 535/1053] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:09 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:10.376286 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-077045ac-a69c-4e5b-a473-c430b75e8fb4 req-541cfc6a-8753-40dd-b884-b0a9ca8ea8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f12455d-8b96-422f-a1aa-258f9a8007f3", "tag": "988344ec-1d62-4410-a33b-e5ff6c251762"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:24:10.396024 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-077045ac-a69c-4e5b-a473-c430b75e8fb4 req-541cfc6a-8753-40dd-b884-b0a9ca8ea8ce service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:10.396855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-077045ac-a69c-4e5b-a473-c430b75e8fb4 req-541cfc6a-8753-40dd-b884-b0a9ca8ea8ce service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:10.397470 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-077045ac-a69c-4e5b-a473-c430b75e8fb4 req-541cfc6a-8753-40dd-b884-b0a9ca8ea8ce service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:10.410633 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-077045ac-a69c-4e5b-a473-c430b75e8fb4 req-541cfc6a-8753-40dd-b884-b0a9ca8ea8ce service nova] Creating event network-changed:988344ec-1d62-4410-a33b-e5ff6c251762 for instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 on hv-cinder-82002 Sep 01 09:24:10.416875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-077045ac-a69c-4e5b-a473-c430b75e8fb4 req-541cfc6a-8753-40dd-b884-b0a9ca8ea8ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044906 Sep 01 09:24:10.417659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 519/1054] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:24:10.861477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-9e78b97b-c2af-4dd0-9665-b974c8b94e7b req-e0a5c296-3afc-4aff-b74a-cb7db53e6c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceaf1c5-17c1-4a73-88e6-7a4d5a93874a", "tag": "6abbc346-39c9-491e-96b8-0d36e5f1263e"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:24:10.873354 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-9e78b97b-c2af-4dd0-9665-b974c8b94e7b req-e0a5c296-3afc-4aff-b74a-cb7db53e6c7d service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:10.874970 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-9e78b97b-c2af-4dd0-9665-b974c8b94e7b req-e0a5c296-3afc-4aff-b74a-cb7db53e6c7d service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:10.875621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-9e78b97b-c2af-4dd0-9665-b974c8b94e7b req-e0a5c296-3afc-4aff-b74a-cb7db53e6c7d service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:10.887674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:10.888127 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-9e78b97b-c2af-4dd0-9665-b974c8b94e7b req-e0a5c296-3afc-4aff-b74a-cb7db53e6c7d service nova] Creating event network-changed:6abbc346-39c9-491e-96b8-0d36e5f1263e for instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a on hv-cinder-82002 Sep 01 09:24:10.888990 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:10.893989 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-9e78b97b-c2af-4dd0-9665-b974c8b94e7b req-e0a5c296-3afc-4aff-b74a-cb7db53e6c7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098534 Sep 01 09:24:10.895076 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 536/1055] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:24:10.896427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:10.897104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:10.897883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:10.898649 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:10.899361 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:10.900061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:10.904642 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:11.122574 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:11.132018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-183e0c46-975c-4241-9787-53dc64d46ba9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.250584 Sep 01 09:24:11.142687 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 520/1056] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:10 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:24:12.153528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:12.154231 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:12.160641 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:12.161130 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:12.161571 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:12.162263 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:12.162722 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:12.163181 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:12.293519 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:12.301935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-da75bce5-9c06-441c-a590-d40e87b65c6f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.153179 Sep 01 09:24:12.302502 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 537/1057] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:12 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:13.322579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:13.323218 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:13.330614 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:13.336950 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:13.336950 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:13.336950 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:13.336950 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:13.337329 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:13.462025 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:13.469776 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a36c8efb-54bd-42e9-bfe1-f40aeea2f7dc tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.151331 Sep 01 09:24:13.470352 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 521/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:13 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:14.490465 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:14.491065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:14.493471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:14.498071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:14.498547 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:14.499090 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:14.499973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:14.500426 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:14.500851 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:14.630407 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:14.637916 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f0669fc9-a24b-40cf-9210-ca5b7a9019af tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.151423 Sep 01 09:24:14.638485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 538/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:14 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:15.659028 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:15.659689 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:15.661998 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:15.666647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:15.667157 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:15.667627 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:15.668311 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:15.668758 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:15.669179 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:15.799610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:15.807534 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4fa02b51-98a2-461b-beb0-95030b4b5935 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.152888 Sep 01 09:24:15.808047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 522/1060] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:15 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:16.829657 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:16.830536 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:16.833315 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:16.833966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=6 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:16.838631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:16.839188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:16.839630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:16.840320 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:16.840769 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:16.841188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:16.977224 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:16.984903 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-65fb23f9-9e92-4dc5-a175-68ecc0b1fcff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.159851 Sep 01 09:24:16.985468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 539/1061] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:16 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:24:17.309289 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-a46e0517-15ee-4598-935d-5c93cd7eb0ec req-dd40115f-6f0e-4913-a980-5acf12766b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12455d-8b96-422f-a1aa-258f9a8007f3", "name": "network-vif-plugged", "status": "completed", "tag": "988344ec-1d62-4410-a33b-e5ff6c251762"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:24:17.315451 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:24:17.316229 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 09:24:17.316578 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:17.323014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a46e0517-15ee-4598-935d-5c93cd7eb0ec req-dd40115f-6f0e-4913-a980-5acf12766b9c service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:17.323518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a46e0517-15ee-4598-935d-5c93cd7eb0ec req-dd40115f-6f0e-4913-a980-5acf12766b9c service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:17.323947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-a46e0517-15ee-4598-935d-5c93cd7eb0ec req-dd40115f-6f0e-4913-a980-5acf12766b9c service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:17.338806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-a46e0517-15ee-4598-935d-5c93cd7eb0ec req-dd40115f-6f0e-4913-a980-5acf12766b9c service nova] Creating event network-vif-plugged:988344ec-1d62-4410-a33b-e5ff6c251762 for instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 on hv-cinder-82002 Sep 01 09:24:17.343605 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-a46e0517-15ee-4598-935d-5c93cd7eb0ec req-dd40115f-6f0e-4913-a980-5acf12766b9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038118 Sep 01 09:24:17.346253 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 523/1062] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:24:18.005791 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:18.006323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:18.012841 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:18.013317 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:18.013747 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:18.015232 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:18.015686 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:18.016115 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:18.143485 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:18.150953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-64999b07-f264-4ea7-a15c-17a2c5184ea9 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.149057 Sep 01 09:24:18.151546 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 540/1063] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:18 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:19.173503 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:19.174220 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:19.180544 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:19.181031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:19.181468 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:19.186748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:19.186748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:19.186748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:19.316402 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:19.324141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ba60574e-1ee9-4b4d-9538-6315a1992223 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1318 microversion: 2.1 time: 0.156103 Sep 01 09:24:19.324709 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 524/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:19 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:20.346445 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:20.347055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:20.353538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:20.354021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:20.354457 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:20.355161 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:20.355621 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:20.356050 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:20.486418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:20.494514 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-157350b7-b940-4196-bf3c-7ca27164b074 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1505 microversion: 2.1 time: 0.152770 Sep 01 09:24:20.499048 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 541/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:20 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:20.515092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a85d7f4-3fb6-4803-92e7-514d908d56ec", "device": "/dev/sdb"}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:24:20.517514 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:20.523900 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:20.524386 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:20.524827 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:20.525519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:20.525981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:20.526411 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:21.269757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3e45ab9a-dc46-4bb9-a756-920d7603cf92 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "POST /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758329 Sep 01 09:24:21.270376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 525/1066] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Sep 1 09:24:20 2022] POST /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:24:44.226563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:44.227058 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:44.229222 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=7 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:44.229905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=36 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:44.234611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:44.235084 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:44.235541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:44.236216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:44.236660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:44.237078 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:44.319430 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lazy-loading 'services' on Instance uuid 9f12455d-8b96-422f-a1aa-258f9a8007f3 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:24:44.540331 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-71bcfa5b-e23e-4782-a24c-e4229b8eb5a1 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3/os-volume_attachments/7a85d7f4-3fb6-4803-92e7-514d908d56ec" status: 202 len: 0 microversion: 2.1 time: 0.317582 Sep 01 09:24:44.540956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 542/1067] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Sep 1 09:24:44 2022] DELETE /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3/os-volume_attachments/7a85d7f4-3fb6-4803-92e7-514d908d56ec => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:24:45.661611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=7 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:45.662531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:24:45.666338 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:45.666928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:45.673757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:45.674238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:45.674671 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:45.675380 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:45.675833 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:45.676255 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:45.700940 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:24:45.977591 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a2e60695-9153-47e9-a15e-b4076a3c16e8 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 204 len: 0 microversion: 2.1 time: 0.317096 Sep 01 09:24:45.978076 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 526/1068] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:24:45 2022] DELETE /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:24:45.988533 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:45.989258 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:45.995592 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:45.996069 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:45.996500 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:45.997180 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:45.997628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:45.998170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:46.131995 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:46.139674 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f1e5826b-e805-429d-82b4-e254eb530f3f tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1511 microversion: 2.1 time: 0.156960 Sep 01 09:24:46.140243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 543/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:45 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:47.161459 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:47.162161 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:47.168555 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:47.169039 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:47.169478 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:47.170168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:47.170624 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:47.171054 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:47.302377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:47.310010 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0c392908-5365-4663-b4a9-d6f4ac6a6c40 tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1511 microversion: 2.1 time: 0.152862 Sep 01 09:24:47.310583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 527/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:47 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:48.332070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:48.332702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:48.339155 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:48.339639 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:48.340073 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:48.340762 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:48.341216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:48.341635 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:48.474210 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:48.482216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b4bf010e-76ff-44c1-9504-1ed31f2398ed tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1511 microversion: 2.1 time: 0.154827 Sep 01 09:24:48.482794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 544/1071] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:48 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:48.769882 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-0ed9c3a3-c64e-49bc-ae36-271e2636d673 req-c4eb999e-d187-4a53-88e2-9220b0effcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12455d-8b96-422f-a1aa-258f9a8007f3", "name": "network-vif-deleted", "tag": "988344ec-1d62-4410-a33b-e5ff6c251762"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:24:48.779623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-0ed9c3a3-c64e-49bc-ae36-271e2636d673 req-c4eb999e-d187-4a53-88e2-9220b0effcfb service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:48.780094 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-0ed9c3a3-c64e-49bc-ae36-271e2636d673 req-c4eb999e-d187-4a53-88e2-9220b0effcfb service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:48.780527 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-0ed9c3a3-c64e-49bc-ae36-271e2636d673 req-c4eb999e-d187-4a53-88e2-9220b0effcfb service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:48.791807 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-0ed9c3a3-c64e-49bc-ae36-271e2636d673 req-c4eb999e-d187-4a53-88e2-9220b0effcfb service nova] Creating event network-vif-deleted:988344ec-1d62-4410-a33b-e5ff6c251762 for instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 on hv-cinder-82002 Sep 01 09:24:48.797320 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-0ed9c3a3-c64e-49bc-ae36-271e2636d673 req-c4eb999e-d187-4a53-88e2-9220b0effcfb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031947 Sep 01 09:24:48.797909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 528/1072] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:24:49.503572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:49.504184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:49.510647 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:49.511136 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:49.511575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:49.512256 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:49.512703 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:49.513123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:49.544504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:49.544899 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:49.545327 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:49.545765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lazy-loading 'fault' on Instance uuid 9f12455d-8b96-422f-a1aa-258f9a8007f3 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:24:49.586191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7538ff30b3ff42a784da0336012f901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c703a441ccd4fd6aed56096783f1086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:24:49.594658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-a6cd8ed7-14af-4311-b429-3a5a09c1d9ff tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 200 len: 1308 microversion: 2.1 time: 0.095098 Sep 01 09:24:49.595271 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 545/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:49 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:24:50.617081 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:24:50.617815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] [instance: 9f12455d-8b96-422f-a1aa-258f9a8007f3] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:24:50.624037 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:50.634291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:50.634291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:50.634291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:24:50.634291 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:24:50.634679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:24:50.640382 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] HTTP exception thrown: Instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 could not be found. Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Request method failure captured: Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 HTTP/1.1 Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHnYjhDX9ROt8S1Bu8LbjAOh7q7MGwMxt75mIQ-IMGMdI6ffwy96G9BKul3hnE_lwG-RF-Fpy8OTQbo8AFbjlOHFE5-aHfGLKNZvTs4J8SY7OnmKfCK8j1NE8FA6V2ChPuHKuDrz48MjQTi-9XGUvaexGRDijUmkS0P77GUUNHupJgY Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 8c703a441ccd4fd6aed56096783f1086 Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1209686020 Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:24:50.642139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c703a441ccd4fd6aed56096783f1086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8c703a441ccd4fd6aed56096783f1086", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c703a441ccd4fd6aed56096783f1086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8c703a441ccd4fd6aed56096783f1086"}]}] Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-VolumesSnapshotTestJSON-1209686020 Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 8c703a441ccd4fd6aed56096783f1086 Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1209686020 Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-VolumesSnapshotTestJSON-1209686020-project Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 7538ff30b3ff42a784da0336012f901d Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-VolumesSnapshotTestJSON-1209686020-project Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 could not be found. Sep 01 09:24:50.643885 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '9f12455d-8b96-422f-a1aa-258f9a8007f3'} Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 could not be found. Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:24:50.644806 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 could not be found. Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 could not be found. Sep 01 09:24:50.646412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:24:50.648167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] Returning 404 to user: Instance 9f12455d-8b96-422f-a1aa-258f9a8007f3 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:24:50.648167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-febd69ef-8e47-4b28-a66d-a0533c65787c tempest-VolumesSnapshotTestJSON-1209686020 tempest-VolumesSnapshotTestJSON-1209686020-project] 10.222.0.46 "GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3" status: 404 len: 111 microversion: 2.1 time: 0.031130 Sep 01 09:24:50.648167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 529/1074] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:24:50 2022] GET /compute/v2.1/servers/9f12455d-8b96-422f-a1aa-258f9a8007f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:25:59.685642 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=10 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:25:59.686712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:25:59.687597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:25:59.687736 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Thu Sep 1 09:25:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.46) !!! Sep 01 09:25:59.859297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-af6a8715-3e49-407a-b88d-0c907a26803b tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Action: 'create', calling method: .version_select at 0x7f7a653b0ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1796876812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC3yZ4w1HG51CZCsuGqjpfwVGB2jDF4r2e9kcCvLnRwesccwr+FFif4/gR/Z5IVP62HBdAb8BmnEJXtULd8g4NhieSM45oiSd4T6w80suucE7//L5/rJLW8m5HG828LZw=="}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:25:59.875709 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-af6a8715-3e49-407a-b88d-0c907a26803b tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for project 94894dd3e80e424b8f34affb48a574ce. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:25:59.879538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.quota [None req-af6a8715-3e49-407a-b88d-0c907a26803b tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for user 440380722a284fbe97aad70139e5ff1f and project 94894dd3e80e424b8f34affb48a574ce. Resources: {'key_pairs'} {{(pid=121062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:25:59.969132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-af6a8715-3e49-407a-b88d-0c907a26803b tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.285345 Sep 01 09:25:59.969739 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 546/1075] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Sep 1 09:25:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:26:24.386682 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:24.387470 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:24.388286 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:26:24.388442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Sep 01 09:26:24.393728 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2078493037", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1796876812", "security_groups": [{"name": "tempest-secgroup-smoke-283940732"}], "block_device_mapping_v2": [{"uuid": "c645524c-2146-44ca-a3ec-c3493c36e9ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11b39e19-cfb7-4f20-8f03-f5557b8a4a3d"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:26:24.611978 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] validate_networks() for [('11b39e19-cfb7-4f20-8f03-f5557b8a4a3d', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:26:25.297850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:26:25.298376 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:26:25.298850 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:26:25.299287 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:26:25.299692 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:26:25.308628 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:25.309104 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:25.309531 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:25.310244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:25.310693 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:25.311131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:25.328658 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for project 94894dd3e80e424b8f34affb48a574ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:26:25.332474 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for user 440380722a284fbe97aad70139e5ff1f and project 94894dd3e80e424b8f34affb48a574ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:26:25.388408 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:26:25.390577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c645524c-2146-44ca-a3ec-c3493c36e9ab',volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:26:25.787305 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2775ed1e-6f21-4a16-a5f2-5bfc5565c091 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.402270 Sep 01 09:26:25.787956 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 530/1076] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:26:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:26:25.796517 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=4 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:25.797345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:25.801446 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d1b44433-7994-4731-8efb-a50f34da71ef tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:25.802131 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d1b44433-7994-4731-8efb-a50f34da71ef tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:25.909569 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d1b44433-7994-4731-8efb-a50f34da71ef tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:25.917070 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d1b44433-7994-4731-8efb-a50f34da71ef tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1095 microversion: 2.1 time: 0.121968 Sep 01 09:26:25.917717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 547/1077] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:25 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1095 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:26.938208 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:26.938825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:26.946186 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:26.946684 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:26.947149 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:26.947863 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:26.948823 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:26.949254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:27.012267 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:27.020044 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-83c0e08c-8f8d-4022-a98a-502d37dcc22c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1145 microversion: 2.1 time: 0.086267 Sep 01 09:26:27.022462 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 531/1078] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:26 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:28.041369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:28.042145 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:28.049483 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:28.049931 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:28.050368 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:28.051060 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:28.051579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:28.052039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:28.116257 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:28.124700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d028b211-95fc-41c8-a7eb-5f93449d6572 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1201 microversion: 2.1 time: 0.087299 Sep 01 09:26:28.125276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 548/1079] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:28 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:26:29.145932 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:29.146568 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:29.153401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:29.153881 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:29.154319 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:29.155005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:29.155691 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:29.156117 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:29.374404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:29.382401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-bd11fdd0-de68-406d-af94-7a0c9db5b526 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1278 microversion: 2.1 time: 0.240402 Sep 01 09:26:29.387339 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 532/1080] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:29 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:26:29.813576 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-38f2dba0-d581-485c-8c3a-a8e7cc1f7ea4 req-0f48b56e-c678-4caa-a77c-3bcee98014e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f", "tag": "b1b62d35-db42-436d-91cf-0bdada3b862a"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:26:29.823562 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-38f2dba0-d581-485c-8c3a-a8e7cc1f7ea4 req-0f48b56e-c678-4caa-a77c-3bcee98014e4 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:29.824041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-38f2dba0-d581-485c-8c3a-a8e7cc1f7ea4 req-0f48b56e-c678-4caa-a77c-3bcee98014e4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:29.824474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-38f2dba0-d581-485c-8c3a-a8e7cc1f7ea4 req-0f48b56e-c678-4caa-a77c-3bcee98014e4 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:29.836243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-38f2dba0-d581-485c-8c3a-a8e7cc1f7ea4 req-0f48b56e-c678-4caa-a77c-3bcee98014e4 service nova] Creating event network-changed:b1b62d35-db42-436d-91cf-0bdada3b862a for instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f on hv-cinder-82002 Sep 01 09:26:29.842231 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-38f2dba0-d581-485c-8c3a-a8e7cc1f7ea4 req-0f48b56e-c678-4caa-a77c-3bcee98014e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032831 Sep 01 09:26:29.843162 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 549/1081] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:26:30.403813 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:30.405169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:30.411904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:30.412466 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:30.412969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:30.413735 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:30.414263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:30.414758 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:30.602448 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:30.610904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-777b899c-b32d-4fa6-934e-6366bef4ff31 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.211316 Sep 01 09:26:30.611602 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 533/1082] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:30 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:26:31.633921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:31.634618 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:31.641370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:31.641854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:31.642292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:31.642981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:31.643468 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:31.643897 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:31.771322 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:31.779765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-02597cff-cbe9-4977-b343-65cbc463a50f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.150579 Sep 01 09:26:31.780332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 550/1083] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:31 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:32.800169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:32.800773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:32.807182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:32.807621 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:32.808055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:32.808794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:32.809247 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:32.809671 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:32.941407 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:32.949633 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9a34d803-a6a7-408b-a13c-9c54bb24bf51 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.152789 Sep 01 09:26:32.950955 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 534/1084] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:32 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:33.970442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:33.971016 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:33.977397 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:33.977884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:33.978335 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:33.979027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:33.979560 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:33.979945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:34.112807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:34.120603 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3fee7784-1a12-4dde-bd54-d6f0975b3645 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.154198 Sep 01 09:26:34.121220 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 551/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:33 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:35.141821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:35.142437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:35.149018 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:35.149506 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:35.149957 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:35.150643 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:35.151095 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:35.151542 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:35.282560 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:35.290215 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0ba3a274-81b5-41e2-b033-26d9b0325781 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.152251 Sep 01 09:26:35.290773 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 535/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:35 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:36.312052 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:36.315309 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:36.315309 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:36.320000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:36.320478 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:36.320911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:36.321588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:36.322039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:36.322575 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:36.452700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:36.460293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b98981b9-d49b-49be-841d-5b269a2cb9ed tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.152984 Sep 01 09:26:36.460854 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 552/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:36 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:37.482484 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:37.483487 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:37.485366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:37.486139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:37.491753 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:37.492271 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:37.492726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:37.493446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:37.493901 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:37.494323 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:37.639487 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:37.647403 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5aa5e89e-c992-4499-bb7f-a0ba85b1ca6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.170839 Sep 01 09:26:37.647975 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 536/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:37 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:38.668837 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:38.669513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:38.675888 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:38.676372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:38.676805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:38.677499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:38.677953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:38.678377 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:38.811712 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:38.819374 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-94ea4e20-c7dd-4278-a525-841e7b92e395 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.154431 Sep 01 09:26:38.819940 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 553/1089] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:38 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:39.840869 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:39.841705 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:39.848494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:39.848985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:39.849420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:39.850129 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:39.850586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:39.851014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:39.983965 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:39.991739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d3121f92-7b74-4567-9773-9da6c8681fe4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.154801 Sep 01 09:26:39.994252 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 537/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:39 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:40.032591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-2b1da239-7f3b-4580-8621-713b49868829 req-75b6e52b-f349-431a-86e4-5cb34ba2e94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f", "name": "network-vif-plugged", "status": "completed", "tag": "b1b62d35-db42-436d-91cf-0bdada3b862a"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:26:40.042788 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-2b1da239-7f3b-4580-8621-713b49868829 req-75b6e52b-f349-431a-86e4-5cb34ba2e94f service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:40.043306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-2b1da239-7f3b-4580-8621-713b49868829 req-75b6e52b-f349-431a-86e4-5cb34ba2e94f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:40.043743 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-2b1da239-7f3b-4580-8621-713b49868829 req-75b6e52b-f349-431a-86e4-5cb34ba2e94f service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:40.056133 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-2b1da239-7f3b-4580-8621-713b49868829 req-75b6e52b-f349-431a-86e4-5cb34ba2e94f service nova] Creating event network-vif-plugged:b1b62d35-db42-436d-91cf-0bdada3b862a for instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f on hv-cinder-82002 Sep 01 09:26:40.061386 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-2b1da239-7f3b-4580-8621-713b49868829 req-75b6e52b-f349-431a-86e4-5cb34ba2e94f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Sep 01 09:26:40.062182 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 554/1091] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:26:41.012182 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:41.012794 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:41.020003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:41.020483 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:41.020916 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:41.021599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:41.022048 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:41.022472 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:41.151841 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:41.159583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-eadf640c-15a4-462c-83ed-6cb1cb1e40bc tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.151220 Sep 01 09:26:41.160190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 538/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:41 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:42.181249 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:42.181937 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:42.188681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:42.189195 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:42.189629 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:42.190316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:42.190768 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:42.191221 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:42.324233 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:42.333098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-39653fa1-6090-4c22-b5af-c28c5033c71e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1266 microversion: 2.1 time: 0.156172 Sep 01 09:26:42.333700 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 555/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:42 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:43.353573 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:43.354183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:43.360639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:43.361115 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:43.361546 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:43.362227 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:43.362679 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:43.363131 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:43.490986 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:43.498685 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f8201df4-00dd-4194-8780-907a93143f03 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1453 microversion: 2.1 time: 0.149034 Sep 01 09:26:43.499281 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 539/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:43 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:43.518602 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:43.519235 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:43.525504 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:43.525983 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:43.526416 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:43.527117 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:43.527572 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:43.527999 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:43.662684 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:43.670373 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-48aed988-acd2-4491-a015-01de0782aba8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1453 microversion: 2.1 time: 0.155953 Sep 01 09:26:43.671123 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 556/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:43 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:45.609466 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-590731a3-861f-402a-8706-c9adcd4dfc0d req-07c8570d-2637-453e-ba83-cda9b4a22010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f", "tag": "b1b62d35-db42-436d-91cf-0bdada3b862a"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:26:45.618913 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-590731a3-861f-402a-8706-c9adcd4dfc0d req-07c8570d-2637-453e-ba83-cda9b4a22010 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:45.619554 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-590731a3-861f-402a-8706-c9adcd4dfc0d req-07c8570d-2637-453e-ba83-cda9b4a22010 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:45.619854 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-590731a3-861f-402a-8706-c9adcd4dfc0d req-07c8570d-2637-453e-ba83-cda9b4a22010 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:45.632427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-590731a3-861f-402a-8706-c9adcd4dfc0d req-07c8570d-2637-453e-ba83-cda9b4a22010 service nova] Creating event network-changed:b1b62d35-db42-436d-91cf-0bdada3b862a for instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f on hv-cinder-82002 Sep 01 09:26:45.637466 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-590731a3-861f-402a-8706-c9adcd4dfc0d req-07c8570d-2637-453e-ba83-cda9b4a22010 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093146 Sep 01 09:26:45.638133 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 540/1096] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:26:55.016235 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:26:55.016769 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:55.019318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=22 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:55.020159 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=46 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:55.024630 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:55.025108 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:55.025541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:55.026253 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:55.026704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:55.027160 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:55.049830 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lazy-loading 'flavor' on Instance uuid bceaf1c5-17c1-4a73-88e6-7a4d5a93874a {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:26:55.429617 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5f19dd40-8042-469d-a0b7-872f2ca13452 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "POST /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a/action" status: 202 len: 0 microversion: 2.1 time: 0.417217 Sep 01 09:26:55.430230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 557/1097] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:26:55 2022] POST /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:26:55.440342 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:55.441931 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:55.442728 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:55.448523 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:55.449013 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:55.449575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:55.450809 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:55.451303 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:55.451732 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:55.454418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=59 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:26:55.590273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:55.602851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7dcf6e3d-02c7-4edb-81eb-c65da4ed7168 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.164416 Sep 01 09:26:55.602851 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 541/1098] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:55 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:56.621134 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:56.621833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:56.629250 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:56.630787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:56.630787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:56.631026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:56.631306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:56.631732 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:56.764616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:56.772762 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-10372aae-c516-4b8a-9ab6-e90a84cee891 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.156319 Sep 01 09:26:56.773338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 558/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:56 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:57.793729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:57.794349 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:57.801191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:57.801674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:57.802111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:57.802800 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:57.803299 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:57.803729 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:57.931815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:57.939978 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0c6d4cc2-54ff-49be-8dc5-49e175ae83c4 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.150091 Sep 01 09:26:57.940556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 542/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:57 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:26:58.961308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:26:58.961862 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:26:58.968440 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:58.969000 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:58.969456 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:58.970191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:26:58.970649 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:26:58.971065 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:26:59.100616 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:26:59.108247 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f93afa6e-8d34-47c4-9a1b-95773d27614e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.150975 Sep 01 09:26:59.108812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 559/1101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:26:58 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:00.131150 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:00.131770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:00.138111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:00.138600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:00.139037 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:00.139744 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:00.140200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:00.141540 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:00.273243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:00.280937 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3a9d969f-9270-4683-b65c-ad85f8e7e787 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.153629 Sep 01 09:27:00.281657 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 543/1102] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:00 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:01.302948 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:01.303597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:01.310030 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:01.310515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:01.310953 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:01.311679 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:01.312771 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:01.313292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:01.440564 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:01.448218 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2c62402a-ff47-4a4a-ad3a-2acbc770ee36 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.149223 Sep 01 09:27:01.448784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 560/1103] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:01 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:02.470235 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:02.470819 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:02.477201 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:02.477677 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:02.478109 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:02.478791 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:02.479271 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:02.479726 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:02.612690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:02.620614 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8f57f369-d981-47cc-8d19-7c5d1ebd8a24 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.154472 Sep 01 09:27:02.621191 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 544/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:02 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:27:03.643614 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:03.644229 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:03.650667 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:03.651184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:03.651626 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:03.652338 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:03.652794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:03.653219 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:03.786985 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:03.794690 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2b4d7b1e-f91f-42a9-8a67-559b79eb40a2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.156083 Sep 01 09:27:03.795284 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 561/1105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:03 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:04.816185 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:04.816732 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:04.823092 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:04.823598 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:04.824030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:04.824711 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:04.825414 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:04.825837 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:04.954023 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:04.961817 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7e70363c-a316-4182-b459-30879ead0fa8 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.149626 Sep 01 09:27:04.962402 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 545/1106] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:04 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:05.983462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:05.984099 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:05.991595 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:05.992079 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:05.992514 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:05.993203 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:05.993657 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:05.994080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:06.131567 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:06.139505 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-78a100a8-f040-407e-b4d8-d18cfb85dc7f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.159908 Sep 01 09:27:06.140101 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 562/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:05 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:07.160628 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:07.161237 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:07.168577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:07.169055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:07.169486 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:07.170172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:07.170626 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:07.171049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:07.304008 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:07.311892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-50672166-b00a-42da-8cdf-0c0301b36499 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.154995 Sep 01 09:27:07.312469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 546/1108] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:07 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:08.333794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:08.334418 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:08.340790 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:08.341278 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:08.341718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:08.342432 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:08.342892 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:08.343356 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:08.479815 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:08.488461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ec9cd75a-0a42-4559-8927-7c9bdc3f3ee9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.158502 Sep 01 09:27:08.489053 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 563/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:08 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:09.510902 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:09.511560 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:09.519005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:09.519644 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:09.520087 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:09.520784 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:09.521243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:09.521671 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:09.654707 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:09.662705 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d7878e48-5dd5-4d9a-b630-c097d8eeb225 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1571 microversion: 2.1 time: 0.155719 Sep 01 09:27:09.663304 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 547/1110] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:09 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:09.683342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:27:09.683947 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:09.690946 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:09.691466 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:09.691911 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:09.692606 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:09.693068 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:09.693497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:09.736497 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121062) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 09:27:10.055394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-9a4c1e92-c907-4765-b1c2-c908f0d8642d req-98ed46ff-53cc-41e6-b336-2ab0b497dd0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceaf1c5-17c1-4a73-88e6-7a4d5a93874a", "name": "network-vif-unplugged", "status": "completed", "tag": "6abbc346-39c9-491e-96b8-0d36e5f1263e"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:27:10.065969 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9a4c1e92-c907-4765-b1c2-c908f0d8642d req-98ed46ff-53cc-41e6-b336-2ab0b497dd0b service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:10.066936 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9a4c1e92-c907-4765-b1c2-c908f0d8642d req-98ed46ff-53cc-41e6-b336-2ab0b497dd0b service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:10.066936 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9a4c1e92-c907-4765-b1c2-c908f0d8642d req-98ed46ff-53cc-41e6-b336-2ab0b497dd0b service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:10.073544 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3608e0d5-97b6-492a-839b-d3a3c3a7142f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "POST /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a/action" status: 202 len: 0 microversion: 2.1 time: 0.394062 Sep 01 09:27:10.074346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 564/1111] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Sep 1 09:27:09 2022] POST /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:27:10.078681 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.compute.server_external_events [req-9a4c1e92-c907-4765-b1c2-c908f0d8642d req-98ed46ff-53cc-41e6-b336-2ab0b497dd0b service nova] Unable to find a host for instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a. Dropping event network-vif-unplugged {{(pid=121063) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 09:27:10.079615 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-9a4c1e92-c907-4765-b1c2-c908f0d8642d req-98ed46ff-53cc-41e6-b336-2ab0b497dd0b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028147 Sep 01 09:27:10.080490 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 548/1112] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 09:27:10.082704 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:10.083343 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:10.089699 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:10.090193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:10.090619 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:10.091463 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:10.091918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:10.097777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:10.233542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:10.242226 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f3adb90a-2aa4-4c4b-8a9e-c00e08eb6128 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1519 microversion: 2.1 time: 0.163336 Sep 01 09:27:10.242807 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 565/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:10 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:11.263647 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:11.264198 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:11.271471 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:11.271954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:11.272394 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:11.273088 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:11.273528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:11.273954 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:11.407820 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:11.415610 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-afdb03d6-9f8c-456e-b008-ce332968356f tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1519 microversion: 2.1 time: 0.156085 Sep 01 09:27:11.416350 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 549/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:11 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:27:12.437243 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:12.437989 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:12.444498 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:12.444986 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:12.445424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:12.446109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:12.446566 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:12.446991 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:12.584787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:12.592717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2ff24833-bbdf-4b3c-b141-23d47c6f09c9 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1521 microversion: 2.1 time: 0.159553 Sep 01 09:27:12.593288 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 566/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:12 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:13.614788 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:13.621421 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:13.621769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:13.622264 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:13.622704 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:13.623423 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:13.623890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:13.624314 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:13.810235 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:13.818232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-bbf0d42f-a22a-4305-9eb5-86aeb90388d1 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.208246 Sep 01 09:27:13.818825 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 550/1116] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:13 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:14.840261 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:14.892971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:14.892971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:14.892971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:14.892971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:14.893454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:14.893454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:14.893454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:14.981370 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:14.989784 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f4410d1e-3f8a-42df-adbb-e8ff0db2bc81 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.153485 Sep 01 09:27:14.990362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 567/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:14 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:16.011162 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:16.011715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:16.018411 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:16.018898 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:16.019367 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:16.020058 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:16.020518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:16.020949 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:16.152769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:16.160538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ed7692a6-78ae-415a-9a5b-cde7ad8ce40c tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.153351 Sep 01 09:27:16.161118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 551/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:16 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:17.182013 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:17.182563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:17.189833 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:17.190318 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:17.190755 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:17.191472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:17.191930 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:17.192356 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:17.322527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:17.331403 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c89e9651-8c20-448d-b887-09ed31c0b20e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.153289 Sep 01 09:27:17.331969 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 568/1119] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:17 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:18.352245 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:18.352884 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:18.359503 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:18.362258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:18.362258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:18.362258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:18.362258 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:18.362749 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:18.491894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:18.499653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-5c6d6a32-5861-4ab8-9140-ba32bf176dc0 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.151283 Sep 01 09:27:18.500238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 552/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:18 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:19.521691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:19.522367 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:19.528692 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:19.529173 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:19.529607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:19.530292 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:19.530746 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:19.531198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:19.666041 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:19.674010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b17890da-6d93-499e-885f-44fb9114867e tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.156140 Sep 01 09:27:19.674579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 569/1121] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:19 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:20.696360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:20.696907 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:20.703609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:20.704090 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:20.704747 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:20.705442 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:20.705895 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:20.706316 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:20.837710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:20.845853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ecaff1be-5313-487c-bf62-679a6d041f48 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.152865 Sep 01 09:27:20.846425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 553/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:20 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:21.866389 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:21.867042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:21.873506 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:21.873996 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:21.874437 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:21.875188 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:21.875651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:21.876080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:21.895186 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:27:22.009438 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:22.017544 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e169ebbb-7027-4cb4-9f4b-888cd17db9ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.155556 Sep 01 09:27:22.018324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 570/1123] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:21 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:23.038036 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:23.038694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:23.045118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:23.045602 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:23.046051 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:23.046719 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:23.047202 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:23.047629 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:23.177791 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:23.185665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2ab4a0d0-01c6-4b77-865c-42257048f3ae tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.151635 Sep 01 09:27:23.186232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 554/1124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:23 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:24.182332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-905e607d-2cc2-4d9d-8b24-3d0a201a9672 req-b4e61e8d-d23a-4041-864c-ef8ab8618bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceaf1c5-17c1-4a73-88e6-7a4d5a93874a", "name": "network-vif-plugged", "status": "completed", "tag": "6abbc346-39c9-491e-96b8-0d36e5f1263e"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:27:24.192650 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-905e607d-2cc2-4d9d-8b24-3d0a201a9672 req-b4e61e8d-d23a-4041-864c-ef8ab8618bb6 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:24.199905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-905e607d-2cc2-4d9d-8b24-3d0a201a9672 req-b4e61e8d-d23a-4041-864c-ef8ab8618bb6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:24.199905 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-905e607d-2cc2-4d9d-8b24-3d0a201a9672 req-b4e61e8d-d23a-4041-864c-ef8ab8618bb6 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:24.204645 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-905e607d-2cc2-4d9d-8b24-3d0a201a9672 req-b4e61e8d-d23a-4041-864c-ef8ab8618bb6 service nova] Creating event network-vif-plugged:6abbc346-39c9-491e-96b8-0d36e5f1263e for instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a on hv-cinder-82002 Sep 01 09:27:24.208225 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:24.208842 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:24.210910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-905e607d-2cc2-4d9d-8b24-3d0a201a9672 req-b4e61e8d-d23a-4041-864c-ef8ab8618bb6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032242 Sep 01 09:27:24.211553 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 571/1125] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:27:24.215665 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:24.216203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:24.216638 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:24.217328 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:24.217782 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:24.218204 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:24.355263 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:24.363183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1fe9e6ab-bd0f-41d9-86bc-d160d6fafbd3 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.159353 Sep 01 09:27:24.363757 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 555/1126] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:24 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:25.385613 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:25.386329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:25.388269 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:27:25.393098 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:25.393577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:25.394029 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:25.394707 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:25.395180 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:25.395601 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:25.528369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:25.536737 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2d25191b-fdf8-478b-ac2c-50fd347463da tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1577 microversion: 2.1 time: 0.155816 Sep 01 09:27:25.537295 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 572/1127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:25 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:27:26.558086 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:27:26.558713 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:27:26.565274 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:26.565875 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:26.566957 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:26.567712 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:27:26.568177 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:27:26.568611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:27:26.572613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=86 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:27:26.697200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:27:26.705113 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-8dc152f3-fd8a-4411-87bb-ac53f969243d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1564 microversion: 2.1 time: 0.151037 Sep 01 09:27:26.705686 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 556/1128] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:27:26 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:28:59.423955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff668e27-c862-4923-baa1-af015ece3eaf] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 09:28:59.424680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=1 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:28:59.425434 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=10 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:28:59.430132 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:28:59.430662 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:28:59.436741 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:28:59.440363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:28:59.440363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:28:59.440363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:28:59.440363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:28:59.440794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:28:59.465021 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:28:59.668501 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f7e1fcf9-a771-4a18-b449-65d1b11911e9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 204 len: 0 microversion: 2.1 time: 0.246175 Sep 01 09:28:59.669149 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 573/1129] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:28:59 2022] DELETE /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:28:59.675363 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=31 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:28:59.676055 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=5 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:28:59.677275 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 09:28:59.677427 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f (ip 10.222.0.46) !!! Sep 01 09:28:59.678431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:28:59.678608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f (ip 10.222.0.46) !!! Sep 01 09:28:59.683359 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:28:59.683963 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:28:59.695003 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:28:59.698171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:28:59.698171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:28:59.698171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:28:59.698171 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:28:59.698649 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:28:59.830939 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:28:59.838708 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-dac90c41-b774-4404-978b-b53f994ce469 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1578 microversion: 2.1 time: 0.165217 Sep 01 09:28:59.839307 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 557/1130] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:28:59 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:29:00.861164 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:00.861782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:00.869373 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:00.869865 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:00.870308 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:00.871028 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:00.871517 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:00.871950 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:00.878226 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff668e27-c862-4923-baa1-af015ece3eaf] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 47536. Sep 01 09:29:01.004568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:01.012192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-e6e90560-03eb-40ab-89d4-c876c456a924 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1578 microversion: 2.1 time: 0.155915 Sep 01 09:29:01.013270 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 574/1131] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:00 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:02.034234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:02.034874 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:02.041718 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:02.042217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:02.042638 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:02.043434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:02.043909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:02.044326 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:02.262580 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:02.271250 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-7186ae7d-839c-496c-ad28-7944d14a8ddf tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1578 microversion: 2.1 time: 0.241839 Sep 01 09:29:02.271855 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 558/1132] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:02 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:02.476632 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-063e3891-59bc-4b57-b912-db70761be359 req-342af8bd-f209-4563-b483-45701f279ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f", "name": "network-vif-deleted", "tag": "b1b62d35-db42-436d-91cf-0bdada3b862a"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:29:02.493813 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-063e3891-59bc-4b57-b912-db70761be359 req-342af8bd-f209-4563-b483-45701f279ca3 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:02.493813 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-063e3891-59bc-4b57-b912-db70761be359 req-342af8bd-f209-4563-b483-45701f279ca3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:02.493813 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-063e3891-59bc-4b57-b912-db70761be359 req-342af8bd-f209-4563-b483-45701f279ca3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:02.502567 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-063e3891-59bc-4b57-b912-db70761be359 req-342af8bd-f209-4563-b483-45701f279ca3 service nova] Creating event network-vif-deleted:b1b62d35-db42-436d-91cf-0bdada3b862a for instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f on hv-cinder-82002 Sep 01 09:29:02.507863 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-063e3891-59bc-4b57-b912-db70761be359 req-342af8bd-f209-4563-b483-45701f279ca3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035637 Sep 01 09:29:02.508481 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 575/1133] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:29:03.293102 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:03.294516 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:03.301274 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:03.307839 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:03.308364 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:03.309152 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:03.309680 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:03.310141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:03.345122 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:03.345608 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:03.346042 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:03.346487 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lazy-loading 'fault' on Instance uuid 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:29:03.386777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:03.395230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3cd1b135-e6a0-4d92-90dd-2d5a8cd41982 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 200 len: 1231 microversion: 2.1 time: 0.106221 Sep 01 09:29:03.395815 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 559/1134] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:03 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:04.422193 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:04.422884 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:04.429010 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:04.429486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:04.429918 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:04.430593 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:04.431044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:04.431486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:04.445525 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] HTTP exception thrown: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Request method failure captured: Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f HTTP/1.1 Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHqhE0XT54Fzux_jBFIQx5-CCgpOFYa52J59mD6CPo-8D9PbCjnvcqoBm6hGjo1EGvHHVypYYKHwJtUrNc-FcOpkFbxvM8fFjq4c19chK5xDvmXt-NMa0XnKhoTzllNmts6lQYwgLWnQVmpkypbA9ayakdvH43Wv6AkpGYI7PaQFZ1g Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:29:04.447259 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94894dd3e80e424b8f34affb48a574ce", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94894dd3e80e424b8f34affb48a574ce"}]}] Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-TestVolumeBootPattern-617763892 Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 440380722a284fbe97aad70139e5ff1f Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:29:04.449342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f'} Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:29:04.450658 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:29:04.452973 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:29:04.454520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Returning 404 to user: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:29:04.454520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-120f3065-446d-485d-9a42-1d3cbafa2380 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 404 len: 111 microversion: 2.1 time: 0.031453 Sep 01 09:29:04.454520 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 576/1135] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:04 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:29:04.496061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1840983292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1796876812", "security_groups": [{"name": "tempest-secgroup-smoke-283940732"}], "block_device_mapping_v2": [{"uuid": "c645524c-2146-44ca-a3ec-c3493c36e9ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11b39e19-cfb7-4f20-8f03-f5557b8a4a3d"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:29:04.613128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] validate_networks() for [('11b39e19-cfb7-4f20-8f03-f5557b8a4a3d', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:29:04.969005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:29:04.969434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:29:04.976156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:29:04.976156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:29:04.976156 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:29:04.979701 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:04.980243 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:04.980683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:04.981409 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:04.982358 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:04.982789 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:05.000047 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for project 94894dd3e80e424b8f34affb48a574ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:29:05.004176 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for user 440380722a284fbe97aad70139e5ff1f and project 94894dd3e80e424b8f34affb48a574ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:29:05.061125 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:29:05.063244 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c645524c-2146-44ca-a3ec-c3493c36e9ab',volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:29:05.441639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-76c1b89e-af70-4059-8e01-43c2f9ac10db tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.949389 Sep 01 09:29:05.442297 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 560/1136] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:29:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:29:05.454191 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ea461c7f-7065-40dd-a260-fffbf3ab1b43 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:05.454797 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ea461c7f-7065-40dd-a260-fffbf3ab1b43 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:05.509794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ea461c7f-7065-40dd-a260-fffbf3ab1b43 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:05.517170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ea461c7f-7065-40dd-a260-fffbf3ab1b43 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1095 microversion: 2.1 time: 0.067528 Sep 01 09:29:05.517737 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 577/1137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:05 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:06.538254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:06.538872 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:06.545236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:06.545730 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:06.546200 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:06.546892 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:06.547419 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:06.547853 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:06.609750 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:06.617545 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-35562d1c-1291-4b67-813c-13c932c14dde tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1145 microversion: 2.1 time: 0.083630 Sep 01 09:29:06.618127 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 561/1138] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:06 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:07.638786 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:07.640117 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:07.647454 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:07.650393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:07.650393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:07.650393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:07.650393 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:07.650755 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:07.715901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:07.724587 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6433b738-9188-425c-9445-eff5323b15e1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1201 microversion: 2.1 time: 0.089623 Sep 01 09:29:07.725207 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 578/1139] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:07 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:08.750455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:08.751132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:08.758199 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:08.758702 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:08.759167 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:08.760472 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:08.761022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:08.761518 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:08.986733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:08.995141 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0ff80030-e8d4-4f2e-8b33-10daf9c84e74 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1278 microversion: 2.1 time: 0.249151 Sep 01 09:29:08.996217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 562/1140] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:08 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:09.422071 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-30740478-216a-461b-9db6-a0def6e542ba req-4ab28636-a5e0-4cdf-ab4b-e452df974024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2588862-ac08-41cf-8b3c-5b0bebc00c70", "tag": "ca786a5e-0b3c-4251-a210-43bfd78318ca"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:29:09.432316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-30740478-216a-461b-9db6-a0def6e542ba req-4ab28636-a5e0-4cdf-ab4b-e452df974024 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:09.432786 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-30740478-216a-461b-9db6-a0def6e542ba req-4ab28636-a5e0-4cdf-ab4b-e452df974024 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:09.433218 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-30740478-216a-461b-9db6-a0def6e542ba req-4ab28636-a5e0-4cdf-ab4b-e452df974024 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:09.444409 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-30740478-216a-461b-9db6-a0def6e542ba req-4ab28636-a5e0-4cdf-ab4b-e452df974024 service nova] Creating event network-changed:ca786a5e-0b3c-4251-a210-43bfd78318ca for instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 on hv-cinder-82002 Sep 01 09:29:09.449660 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-30740478-216a-461b-9db6-a0def6e542ba req-4ab28636-a5e0-4cdf-ab4b-e452df974024 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032048 Sep 01 09:29:09.450433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 579/1141] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:29:10.018437 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:10.019184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:10.025627 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:10.026111 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:10.026549 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:10.027281 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:10.027743 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:10.028169 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:10.244360 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:10.253984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2d1f4182-2c99-4dc7-844a-fee295d9aa88 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.239963 Sep 01 09:29:10.256877 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 563/1142] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:10 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:11.139955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:11.141069 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:11.141452 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-b14e4e86-32ae-4f70-96a9-8e5eecec759f req-2551a8b7-650d-4a13-b245-211a23ff6042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceaf1c5-17c1-4a73-88e6-7a4d5a93874a", "tag": "6abbc346-39c9-491e-96b8-0d36e5f1263e"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:29:11.150923 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:11.151587 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:11.151979 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b14e4e86-32ae-4f70-96a9-8e5eecec759f req-2551a8b7-650d-4a13-b245-211a23ff6042 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:11.152107 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:11.152548 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b14e4e86-32ae-4f70-96a9-8e5eecec759f req-2551a8b7-650d-4a13-b245-211a23ff6042 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:11.152705 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:11.153061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b14e4e86-32ae-4f70-96a9-8e5eecec759f req-2551a8b7-650d-4a13-b245-211a23ff6042 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:11.153192 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:11.153701 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:11.165041 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-b14e4e86-32ae-4f70-96a9-8e5eecec759f req-2551a8b7-650d-4a13-b245-211a23ff6042 service nova] Creating event network-changed:6abbc346-39c9-491e-96b8-0d36e5f1263e for instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a on hv-cinder-82002 Sep 01 09:29:11.172418 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-b14e4e86-32ae-4f70-96a9-8e5eecec759f req-2551a8b7-650d-4a13-b245-211a23ff6042 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 Sep 01 09:29:11.173232 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 564/1143] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:29:11.180557 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:29:11.277043 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:11.277754 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:11.284947 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:11.285600 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:11.286030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:11.287038 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:11.287746 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:11.288397 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:11.507477 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-202b30a5-a2bd-4fe1-b742-6617f02cdb89 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 204 len: 0 microversion: 2.1 time: 0.368933 Sep 01 09:29:11.508603 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:11.509178 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 580/1144] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:29:11 2022] DELETE /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:29:11.518458 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ea73841d-cb93-4309-8c26-0c6571fd2b99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.245793 Sep 01 09:29:11.519184 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 565/1145] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:11 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:29:11.523261 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:11.523891 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:11.530433 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:11.536377 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:11.536901 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:11.537698 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:11.538426 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:11.538912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:11.678083 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:11.686264 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-f70b27dc-c3c7-4548-9f23-ff6b3fe06d6a tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.176913 Sep 01 09:29:11.686965 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 581/1146] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:11 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:12.539925 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:12.549889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:12.549889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:12.549889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:12.549889 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:12.550317 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:12.550317 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:12.550317 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:12.708144 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:12.708719 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:12.714945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:12.715459 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:12.715902 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:12.716590 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:12.717044 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:12.718002 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:12.781457 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:12.788601 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-4d40e32d-1e74-43a6-ab28-b9b7c085df87 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.252478 Sep 01 09:29:12.789190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 566/1147] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:12 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:12.847532 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:12.855230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1abc0477-5add-416e-8459-98b4b168b3c2 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1570 microversion: 2.1 time: 0.151055 Sep 01 09:29:12.855804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 582/1148] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:12 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:29:13.770128 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-9614902c-701b-4277-9599-202fe9e7a845 req-e57630a0-cc1f-4d5c-be22-9d180dbc98a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceaf1c5-17c1-4a73-88e6-7a4d5a93874a", "name": "network-vif-deleted", "tag": "6abbc346-39c9-491e-96b8-0d36e5f1263e"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:29:13.779431 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9614902c-701b-4277-9599-202fe9e7a845 req-e57630a0-cc1f-4d5c-be22-9d180dbc98a0 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:13.780594 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9614902c-701b-4277-9599-202fe9e7a845 req-e57630a0-cc1f-4d5c-be22-9d180dbc98a0 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:13.781041 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-9614902c-701b-4277-9599-202fe9e7a845 req-e57630a0-cc1f-4d5c-be22-9d180dbc98a0 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:13.792057 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-9614902c-701b-4277-9599-202fe9e7a845 req-e57630a0-cc1f-4d5c-be22-9d180dbc98a0 service nova] Creating event network-vif-deleted:6abbc346-39c9-491e-96b8-0d36e5f1263e for instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a on hv-cinder-82002 Sep 01 09:29:13.796918 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-9614902c-701b-4277-9599-202fe9e7a845 req-e57630a0-cc1f-4d5c-be22-9d180dbc98a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091205 Sep 01 09:29:13.804248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 567/1149] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:29:13.809612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:13.810223 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:13.816651 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:13.817134 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:13.817568 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:13.818260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:13.818717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:13.819168 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:13.878101 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:13.878984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:13.885405 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:13.890212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:13.890212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:13.890212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:13.890212 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:13.890733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:13.953894 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:13.959201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:13.962639 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-05ebe140-9efd-424e-8671-908f3a7a05c7 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1220 microversion: 2.1 time: 0.089103 Sep 01 09:29:13.963334 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 568/1150] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:13 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:29:13.969406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d920ed35-23ba-4308-b2c6-d9c4544e8c17 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.161309 Sep 01 09:29:13.969406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 583/1151] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:13 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:14.984539 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:14.985238 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:14.988628 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:14.990610 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:14.991842 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:29:14.994217 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:14.994777 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:14.995251 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:14.995881 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:14.996011 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:14.996365 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:14.996617 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:14.996794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:14.997118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:14.997486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:14.997935 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:14.998357 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:15.013428 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:29:15.029926 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:15.030414 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:15.030860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:15.031860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lazy-loading 'fault' on Instance uuid bceaf1c5-17c1-4a73-88e6-7a4d5a93874a {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:29:15.072329 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702cf20256a74edcad54abbc464cb099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e76e29a48415681a0047f72bb9e8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:15.081022 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d4087a62-31d9-454b-8b50-b6d5aeda7c20 tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 200 len: 1225 microversion: 2.1 time: 0.100588 Sep 01 09:29:15.081611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 569/1152] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:14 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:15.144034 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:15.151753 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-9e9cd7ad-3276-4399-a533-a4d0a150bb07 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.168077 Sep 01 09:29:15.152323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 584/1153] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:14 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:29:16.104445 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:16.105164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] [instance: bceaf1c5-17c1-4a73-88e6-7a4d5a93874a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:16.113254 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:16.117064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:16.117064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:16.117064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:16.117064 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:16.117469 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:16.129378 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] HTTP exception thrown: Instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a could not be found. Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Request method failure captured: Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a HTTP/1.1 Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHnwCN5tg4KsKHb1G-0G8xLvI4V5K73MHDdFiYcjFpdyyScSoFbTxp4fF8mxNa6RQZkfwGsTwYYOyGnaCdIyMf13U38bl4FABizDpUd8Spc0dAO0VbSL-3KK5JPphoDzIt9e6kk4iL-HKqypFxtPlo5WGN45lwuR8Kq4rq8t4ngM0z8 Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 049e76e29a48415681a0047f72bb9e8c Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-TestShelveInstance-413370123 Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:29:16.131005 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/049e76e29a48415681a0047f72bb9e8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_049e76e29a48415681a0047f72bb9e8c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/049e76e29a48415681a0047f72bb9e8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/049e76e29a48415681a0047f72bb9e8c"}]}] Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-TestShelveInstance-413370123 Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 049e76e29a48415681a0047f72bb9e8c Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-TestShelveInstance-413370123 Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-TestShelveInstance-413370123-project Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 702cf20256a74edcad54abbc464cb099 Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-TestShelveInstance-413370123-project Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a could not be found. Sep 01 09:29:16.132745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'bceaf1c5-17c1-4a73-88e6-7a4d5a93874a'} Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a could not be found. Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:29:16.133772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a could not be found. Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a could not be found. Sep 01 09:29:16.135436 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:29:16.136930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Returning 404 to user: Instance bceaf1c5-17c1-4a73-88e6-7a4d5a93874a could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:29:16.136930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6f25a1c5-6cc1-4931-9652-b29ff68fc97d tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a" status: 404 len: 111 microversion: 2.1 time: 0.031833 Sep 01 09:29:16.136930 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 570/1154] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:16 2022] GET /compute/v2.1/servers/bceaf1c5-17c1-4a73-88e6-7a4d5a93874a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:29:16.173283 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:16.173945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:16.175936 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:29:16.181528 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:16.182018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:16.182461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:16.183212 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:16.183758 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:16.184195 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:16.320987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:16.329663 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-61154d8a-39a7-4ebc-96aa-4ba8c161afa8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.160871 Sep 01 09:29:16.330239 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 585/1155] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:16 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:16.387345 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-0cdd84ad-2e8e-45e4-9c67-d75aa510a7fe tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] Calling method '.version_select at 0x7f7a655a98b0>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:16.457676 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-0cdd84ad-2e8e-45e4-9c67-d75aa510a7fe tempest-TestShelveInstance-413370123 tempest-TestShelveInstance-413370123-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1795981516" status: 202 len: 0 microversion: 2.1 time: 0.074188 Sep 01 09:29:16.458272 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 571/1156] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Sep 1 09:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1795981516 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 09:29:17.351034 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:17.351744 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:17.358108 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:17.358597 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:17.359039 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:17.360272 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:17.360736 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:17.361171 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:17.496362 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:17.504515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-73441f79-222a-4d34-b347-0f23416c772e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.157326 Sep 01 09:29:17.505093 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 586/1157] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:17 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:18.526910 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:18.528203 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:18.539494 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:18.539983 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:18.540415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:18.541344 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:18.541801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:18.542224 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:18.767718 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:18.775433 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9406d4b4-a4d8-491f-b473-adba8c93421e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.252685 Sep 01 09:29:18.777595 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 572/1158] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:18 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:19.798399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:19.799034 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:19.805955 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:19.812346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:19.812346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:19.812346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:19.812346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:19.813453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:20.321328 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:20.329762 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-1d7d09e8-6763-40c7-a8e8-ccba79ee3bf4 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.536332 Sep 01 09:29:20.330345 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 587/1159] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:19 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:29:21.350630 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:21.351362 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:21.357849 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:21.358922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:21.358922 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:21.359917 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:21.360384 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:21.360813 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:21.607234 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:21.615446 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-23a604b3-3892-4899-80eb-63b16bbc700f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.268874 Sep 01 09:29:21.616026 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 573/1160] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:21 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:22.636734 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:22.637280 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:22.645702 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:22.646634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:22.647297 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:22.648012 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:22.648472 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:22.648897 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:22.913274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:22.921170 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-dd3d6805-bf41-4ce0-8053-ef405b348363 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.288862 Sep 01 09:29:22.924515 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 588/1161] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:22 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:23.039543 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-b82c2c1b-4c08-4fc7-aa24-0681a963c820 req-ab9ce3ad-123b-47ad-9bd5-c76fad79637e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2588862-ac08-41cf-8b3c-5b0bebc00c70", "name": "network-vif-plugged", "status": "completed", "tag": "ca786a5e-0b3c-4251-a210-43bfd78318ca"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:29:23.050155 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b82c2c1b-4c08-4fc7-aa24-0681a963c820 req-ab9ce3ad-123b-47ad-9bd5-c76fad79637e service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:23.050870 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b82c2c1b-4c08-4fc7-aa24-0681a963c820 req-ab9ce3ad-123b-47ad-9bd5-c76fad79637e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:23.051556 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-b82c2c1b-4c08-4fc7-aa24-0681a963c820 req-ab9ce3ad-123b-47ad-9bd5-c76fad79637e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:23.065401 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-b82c2c1b-4c08-4fc7-aa24-0681a963c820 req-ab9ce3ad-123b-47ad-9bd5-c76fad79637e service nova] Creating event network-vif-plugged:ca786a5e-0b3c-4251-a210-43bfd78318ca for instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 on hv-cinder-82002 Sep 01 09:29:23.071439 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-b82c2c1b-4c08-4fc7-aa24-0681a963c820 req-ab9ce3ad-123b-47ad-9bd5-c76fad79637e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097626 Sep 01 09:29:23.072909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 574/1162] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:29:23.941885 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:23.943316 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:23.949912 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:23.950406 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:23.950945 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:23.951942 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:23.952417 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:23.953198 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:23.962399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:29:24.151541 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:24.159718 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3ab2d0bc-3384-45a5-b86d-63cbed91cbb8 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.221797 Sep 01 09:29:24.160290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 589/1163] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:23 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:25.181032 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:25.181762 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:25.189101 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:25.189584 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:25.190020 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:25.190714 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:25.191278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:25.191694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:25.322706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:25.337783 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-70827af5-105f-4638-b046-b5bb71607efb tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1266 microversion: 2.1 time: 0.161232 Sep 01 09:29:25.338400 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 575/1164] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:25 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:26.358394 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:26.359586 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:26.366335 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:26.366812 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:26.367276 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:26.367956 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:26.368410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:26.368831 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:26.497451 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:26.505828 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-5a5d5eb4-a0cd-4c1c-ab7d-350d666e6f4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1454 microversion: 2.1 time: 0.151703 Sep 01 09:29:26.506395 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 590/1165] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:26 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:29:26.525318 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:29:26.525928 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:29:26.532497 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:26.532981 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:26.533415 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:26.534107 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:26.534558 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:26.534980 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:26.666611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:29:26.675634 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-1d7749ba-ed29-46d4-b822-61390be0d713 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1454 microversion: 2.1 time: 0.154096 Sep 01 09:29:26.676207 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 576/1166] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:29:26 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:29:28.490201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-4c6e7d91-55c6-4e36-8670-34c98bf6d22b req-fb811754-f752-4a7a-9b09-bc4f656e41af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2588862-ac08-41cf-8b3c-5b0bebc00c70", "tag": "ca786a5e-0b3c-4251-a210-43bfd78318ca"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:29:28.499805 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-4c6e7d91-55c6-4e36-8670-34c98bf6d22b req-fb811754-f752-4a7a-9b09-bc4f656e41af service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:29:28.500282 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-4c6e7d91-55c6-4e36-8670-34c98bf6d22b req-fb811754-f752-4a7a-9b09-bc4f656e41af service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:29:28.500711 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-4c6e7d91-55c6-4e36-8670-34c98bf6d22b req-fb811754-f752-4a7a-9b09-bc4f656e41af service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:29:28.512936 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-4c6e7d91-55c6-4e36-8670-34c98bf6d22b req-fb811754-f752-4a7a-9b09-bc4f656e41af service nova] Creating event network-changed:ca786a5e-0b3c-4251-a210-43bfd78318ca for instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 on hv-cinder-82002 Sep 01 09:29:28.519332 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-4c6e7d91-55c6-4e36-8670-34c98bf6d22b req-fb811754-f752-4a7a-9b09-bc4f656e41af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032837 Sep 01 09:29:28.520369 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 591/1167] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:31:42.480761 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-275945284", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1796876812", "security_groups": [{"name": "tempest-secgroup-smoke-283940732"}], "block_device_mapping_v2": [{"uuid": "06b432d9-8c66-4b42-8061-7bb4490e7483", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11b39e19-cfb7-4f20-8f03-f5557b8a4a3d"}]}} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:31:42.491424 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6dd50ef-b3f5-4304-b6cb-fc2e85c48f42] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 09:31:42.491941 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:31:42.492611 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=98 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:31:42.493538 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 09:31:42.493671 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Sep 01 09:31:42.732769 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.network.neutron [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] validate_networks() for [('11b39e19-cfb7-4f20-8f03-f5557b8a4a3d', None, None, None, None, None)] {{(pid=121063) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 09:31:43.433860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Flavor limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 09:31:43.434299 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Image limits 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 09:31:43.434780 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Flavor pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 09:31:43.435231 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Image pref 0:0:0 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 09:31:43.435659 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.virt.hardware [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 09:31:43.444490 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:43.444976 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:43.445674 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:43.446402 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:43.446861 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:43.447325 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:43.464703 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for project 94894dd3e80e424b8f34affb48a574ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 09:31:43.468764 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.quota [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Getting quotas for user 440380722a284fbe97aad70139e5ff1f and project 94894dd3e80e424b8f34affb48a574ce. Resources: {'cores', 'ram', 'instances'} {{(pid=121063) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 09:31:43.498524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6dd50ef-b3f5-4304-b6cb-fc2e85c48f42] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 47788. Sep 01 09:31:43.525720 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Going to run 1 instances... {{(pid=121063) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 09:31:43.528455 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06b432d9-8c66-4b42-8061-7bb4490e7483',volume_size=None,volume_type=None)] {{(pid=121063) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 09:31:43.856562 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-aca25780-305e-4cb9-8cef-841f898411b0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.380472 Sep 01 09:31:43.857225 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 577/1168] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Sep 1 09:31:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 09:31:43.866570 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:31:43.867339 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=12 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:31:43.868239 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:31:43.868409 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Thu Sep 1 09:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a (ip 10.222.0.46) !!! Sep 01 09:31:43.870794 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 09:31:43.870932 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Thu Sep 1 09:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a (ip 10.222.0.46) !!! Sep 01 09:31:43.872971 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:31:43.874342 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Thu Sep 1 09:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a (ip 10.222.0.46) !!! Sep 01 09:31:43.879273 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-3b2bee4c-fa45-44c8-90a0-a932a1186a9c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:43.880086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-3b2bee4c-fa45-44c8-90a0-a932a1186a9c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:44.011545 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-3b2bee4c-fa45-44c8-90a0-a932a1186a9c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:44.018424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-3b2bee4c-fa45-44c8-90a0-a932a1186a9c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1094 microversion: 2.1 time: 0.154220 Sep 01 09:31:44.018990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 592/1169] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:43 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1094 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:45.038878 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:45.039528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:45.046311 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:45.046873 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:45.047356 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:45.048053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:45.048512 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:45.048942 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:45.118017 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:45.127449 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f0929574-138b-47ec-b8c6-bdf46c1b4c5a tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1192 microversion: 2.1 time: 0.092425 Sep 01 09:31:45.128014 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 578/1170] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:45 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:46.155391 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:46.156016 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:46.163634 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:46.164126 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:46.164578 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:46.165324 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:46.165787 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:46.166260 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:46.235951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:46.243889 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-db804b67-8b40-47b2-b71c-c5f644f8b707 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1210 microversion: 2.1 time: 0.093652 Sep 01 09:31:46.244475 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 593/1171] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:46 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:47.266452 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:47.267067 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:47.273524 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:47.274016 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:47.274448 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:47.275164 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:47.275618 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:47.276250 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:47.317158 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-9b72751d-9229-453a-b58d-b09cb91e2077 req-f4246af5-037b-4466-8131-1885dd8805df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a39d9f-21f4-4b41-b6a9-ce2c31fee22a", "tag": "dd16b05d-d642-441e-8456-60b16f2003cb"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:31:47.328009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-9b72751d-9229-453a-b58d-b09cb91e2077 req-f4246af5-037b-4466-8131-1885dd8805df service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:47.334482 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-9b72751d-9229-453a-b58d-b09cb91e2077 req-f4246af5-037b-4466-8131-1885dd8805df service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:47.334482 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-9b72751d-9229-453a-b58d-b09cb91e2077 req-f4246af5-037b-4466-8131-1885dd8805df service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:47.339968 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-9b72751d-9229-453a-b58d-b09cb91e2077 req-f4246af5-037b-4466-8131-1885dd8805df service nova] Creating event network-changed:dd16b05d-d642-441e-8456-60b16f2003cb for instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a on hv-cinder-82002 Sep 01 09:31:47.345866 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-9b72751d-9229-453a-b58d-b09cb91e2077 req-f4246af5-037b-4466-8131-1885dd8805df service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032359 Sep 01 09:31:47.346615 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 594/1172] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:31:47.509818 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:47.518584 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-ca230cf9-54ed-47d2-860d-f573dc55b378 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.255924 Sep 01 09:31:47.519190 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 579/1173] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:47 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:48.542358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:48.543201 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:48.549844 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:48.550293 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:48.550726 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:48.551448 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:48.551900 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:48.552323 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:48.680717 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:48.688542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-b7595605-9911-47b1-8a3c-ed3de343b347 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.151042 Sep 01 09:31:48.689113 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 595/1174] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:48 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:49.709697 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:49.710308 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:49.717359 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:49.717840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:49.718273 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:49.718951 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:49.719434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:49.719860 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:49.852426 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:49.857301 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-34e78a45-8f01-4580-9763-d502d05cf3f1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.151550 Sep 01 09:31:49.857879 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 580/1175] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:49 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:50.879921 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:50.880473 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:50.887197 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:50.887680 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:50.888114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:50.888795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:50.889245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:50.889665 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:51.018155 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:51.026275 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-da3eb273-a25b-456c-906c-c71dea45ae53 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.151518 Sep 01 09:31:51.026847 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 596/1176] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:50 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:52.047107 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:52.047745 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:52.054105 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:52.054586 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:52.055027 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:52.055741 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:52.056198 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:52.056625 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:52.183724 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:52.191366 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-bdf512e9-5d83-49d6-8d51-916a26d0ea08 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.148135 Sep 01 09:31:52.191944 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 581/1177] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:52 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:53.211966 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:53.212607 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:53.219538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:53.220022 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:53.220462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:53.221151 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:53.221612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:53.222042 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:53.355793 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:53.363411 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-2fc317dc-a3d2-4d3f-bdc1-f4cacd97c5d9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.155342 Sep 01 09:31:53.363990 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 597/1178] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:53 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:54.385150 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:54.386253 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:54.388576 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=2 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:31:54.389255 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell0:SELECT=6 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:31:54.393985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:54.394519 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:54.394964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:54.395683 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:54.396148 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:54.396579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:54.531508 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:54.539599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3096e462-764c-4f6c-8f30-4235d3f1ba79 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.158349 Sep 01 09:31:54.540183 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 582/1179] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:54 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:55.570538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:55.570538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:55.570538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell0:SELECT=2 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:31:55.570538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:55.570538 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:55.571442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:55.571442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:55.571442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:55.571442 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:55.705399 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:55.712988 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-afc8df9d-5636-4902-87f7-069618c75fb7 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.156610 Sep 01 09:31:55.713590 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 598/1180] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:55 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:56.738246 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:56.738880 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:56.746577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:56.747063 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:56.747541 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:56.748236 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:56.748700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:56.749132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:56.881165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:56.888987 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-6bfbe274-03a4-45f8-8058-439210a7675d tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.154579 Sep 01 09:31:56.889581 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 583/1181] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:56 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:57.909797 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:57.910460 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:57.917100 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:57.917987 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:57.918424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:57.919143 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:57.919608 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:57.920038 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:58.054200 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:58.062124 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-36ad314e-56e2-470b-9d1e-53728127eae5 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.156159 Sep 01 09:31:58.062693 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 599/1182] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:57 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:59.083575 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:31:59.084230 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:31:59.091289 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:59.091772 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:59.092205 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:59.092890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:59.093347 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:59.093770 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:59.225903 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:31:59.234823 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-3bae3bff-b366-45de-9056-8dd9e9350447 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.155061 Sep 01 09:31:59.235432 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 584/1183] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:31:59 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:31:59.605772 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-e81e3756-5afd-494e-9145-f30c079072e3 req-08d4ff46-50a2-4d30-a4b5-fb16b5036f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a39d9f-21f4-4b41-b6a9-ce2c31fee22a", "name": "network-vif-plugged", "status": "completed", "tag": "dd16b05d-d642-441e-8456-60b16f2003cb"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:31:59.616119 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-e81e3756-5afd-494e-9145-f30c079072e3 req-08d4ff46-50a2-4d30-a4b5-fb16b5036f65 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:31:59.616588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-e81e3756-5afd-494e-9145-f30c079072e3 req-08d4ff46-50a2-4d30-a4b5-fb16b5036f65 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:31:59.617018 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-e81e3756-5afd-494e-9145-f30c079072e3 req-08d4ff46-50a2-4d30-a4b5-fb16b5036f65 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:31:59.627804 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-e81e3756-5afd-494e-9145-f30c079072e3 req-08d4ff46-50a2-4d30-a4b5-fb16b5036f65 service nova] Creating event network-vif-plugged:dd16b05d-d642-441e-8456-60b16f2003cb for instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a on hv-cinder-82002 Sep 01 09:31:59.632765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-e81e3756-5afd-494e-9145-f30c079072e3 req-08d4ff46-50a2-4d30-a4b5-fb16b5036f65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030795 Sep 01 09:31:59.633591 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 600/1184] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:32:00.256118 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:32:00.256739 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:32:00.264867 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:00.265356 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:00.265801 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:00.266500 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:00.266963 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:00.267434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:00.397404 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:32:00.405715 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-579b77ab-6c30-473b-bdb6-9f2a0b83fec9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.153509 Sep 01 09:32:00.406287 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 585/1185] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:32:00 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:32:01.429577 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:32:01.430274 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:32:01.438023 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:01.438513 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:01.439226 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:01.439934 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:01.440392 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:01.440910 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:01.580114 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:32:01.587920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-fd78769e-cab3-484f-804c-7f30096e221e tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1265 microversion: 2.1 time: 0.163542 Sep 01 09:32:01.588563 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 601/1186] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:32:01 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:32:02.609811 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:32:02.610425 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:32:02.616842 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:02.617324 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:02.617766 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:02.618453 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:02.618909 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:02.619377 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:02.751695 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:32:02.759583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-add40047-a3f8-4d7b-8a6a-5083fa48aa0c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1453 microversion: 2.1 time: 0.153668 Sep 01 09:32:02.760159 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 586/1187] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:32:02 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:32:02.780167 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:32:02.780777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:32:02.787589 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:02.788064 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:02.788499 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:02.789179 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:02.789631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:02.790051 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:02.917329 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:32:02.925291 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-ba5a6ac2-edb9-484a-8a3d-4148aa3f3246 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1453 microversion: 2.1 time: 0.149921 Sep 01 09:32:02.925872 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 602/1188] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:32:02 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:32:04.897235 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a39d9f-21f4-4b41-b6a9-ce2c31fee22a", "tag": "dd16b05d-d642-441e-8456-60b16f2003cb"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:32:04.907220 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:32:04.907706 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:32:04.908139 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:32:04.919690 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] Creating event network-changed:dd16b05d-d642-441e-8456-60b16f2003cb for instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a on hv-cinder-82002 Sep 01 09:32:04.923172 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR oslo.messaging._drivers.impl_rabbit [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] [53e2e640-0478-4b19-97ed-3427bc2af040] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 09:32:05.931890 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] [53e2e640-0478-4b19-97ed-3427bc2af040] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 47866. Sep 01 09:32:05.937256 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-21d88f03-e65e-4518-a4e3-a0d59ae815ed req-59e4fcda-c362-4171-b998-63dbf00759cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.102076 Sep 01 09:32:05.937583 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 587/1189] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:33:52.464951 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_api:SELECT=24 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:33:52.466055 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG dbcounter [-] [121062] Writing DB stats nova_cell1:SELECT=52 {{(pid=121062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:33:52.467447 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6dd50ef-b3f5-4304-b6cb-fc2e85c48f42] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 09:33:52.468616 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:33:52.469895 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG dbcounter [-] [121063] Writing DB stats nova_cell1:SELECT=58 {{(pid=121063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:33:52.471189 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 09:33:52.474708 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Thu Sep 1 09:33:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 01 09:33:52.474837 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:33:52.475378 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:33:52.476904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [req-25b36259-811a-4683-9342-9941e470bf63 req-67aae5f9-0a0a-4cef-b7df-fd1c40b1dbca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a39d9f-21f4-4b41-b6a9-ce2c31fee22a", "tag": "dd16b05d-d642-441e-8456-60b16f2003cb"}]} {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:33:52.482185 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:52.482749 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:52.483306 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:52.484084 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:52.484782 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:52.485461 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:52.488278 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-25b36259-811a-4683-9342-9941e470bf63 req-67aae5f9-0a0a-4cef-b7df-fd1c40b1dbca service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:52.488984 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-25b36259-811a-4683-9342-9941e470bf63 req-67aae5f9-0a0a-4cef-b7df-fd1c40b1dbca service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:52.489412 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [req-25b36259-811a-4683-9342-9941e470bf63 req-67aae5f9-0a0a-4cef-b7df-fd1c40b1dbca service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:52.502052 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.compute.server_external_events [req-25b36259-811a-4683-9342-9941e470bf63 req-67aae5f9-0a0a-4cef-b7df-fd1c40b1dbca service nova] Creating event network-changed:dd16b05d-d642-441e-8456-60b16f2003cb for instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a on hv-cinder-82002 Sep 01 09:33:52.507883 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [req-25b36259-811a-4683-9342-9941e470bf63 req-67aae5f9-0a0a-4cef-b7df-fd1c40b1dbca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042622 Sep 01 09:33:52.508989 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 588/1190] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 09:33:52.518209 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Going to try to terminate instance {{(pid=121062) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:33:52.759216 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-c4674f13-9e88-47d3-bce1-cd864f33ff45 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "DELETE /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 204 len: 0 microversion: 2.1 time: 0.296245 Sep 01 09:33:52.759928 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 603/1191] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:33:52 2022] DELETE /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 09:33:52.770030 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:33:52.770768 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:33:52.778091 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:52.778593 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:52.779132 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:52.780019 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:52.780480 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:52.781031 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:52.914812 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:33:52.923623 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-200da58a-c465-4cf2-9f4a-883d85a40c99 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1577 microversion: 2.1 time: 0.159105 Sep 01 09:33:52.925694 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 589/1192] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:33:52 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:33:53.945410 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:33:53.946225 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:33:53.953080 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:53.954027 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:53.954462 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:53.955239 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:53.955691 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:53.956128 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:54.097544 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:33:54.105226 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-d808d08a-e3cd-4c8d-aad5-a46d402f4886 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1577 microversion: 2.1 time: 0.164142 Sep 01 09:33:54.105789 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 604/1193] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:33:53 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:33:55.126434 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:33:55.127061 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:33:55.138924 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6dd50ef-b3f5-4304-b6cb-fc2e85c48f42] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 47922. Sep 01 09:33:55.141395 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:55.141904 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:55.142332 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:55.143037 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:55.143525 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:55.143958 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:55.288357 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:33:55.296165 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-80f5e041-b244-4e38-8846-87d3032c2701 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1459 microversion: 2.1 time: 0.174277 Sep 01 09:33:55.296796 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 590/1194] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:33:55 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1459 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:33:55.515230 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-907d0518-2429-4e72-b151-378dd87d9268 req-88665b09-f993-4e2b-90ba-0d020d206980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a39d9f-21f4-4b41-b6a9-ce2c31fee22a", "name": "network-vif-deleted", "tag": "dd16b05d-d642-441e-8456-60b16f2003cb"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:33:55.525620 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-907d0518-2429-4e72-b151-378dd87d9268 req-88665b09-f993-4e2b-90ba-0d020d206980 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:55.526095 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-907d0518-2429-4e72-b151-378dd87d9268 req-88665b09-f993-4e2b-90ba-0d020d206980 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:55.526530 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-907d0518-2429-4e72-b151-378dd87d9268 req-88665b09-f993-4e2b-90ba-0d020d206980 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:55.537346 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-907d0518-2429-4e72-b151-378dd87d9268 req-88665b09-f993-4e2b-90ba-0d020d206980 service nova] Creating event network-vif-deleted:dd16b05d-d642-441e-8456-60b16f2003cb for instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a on hv-cinder-82002 Sep 01 09:33:55.542360 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-907d0518-2429-4e72-b151-378dd87d9268 req-88665b09-f993-4e2b-90ba-0d020d206980 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030744 Sep 01 09:33:55.542938 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 605/1195] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:33:56.317577 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:33:56.318260 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:33:56.324805 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:56.325283 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:56.325716 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:56.326398 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:56.326852 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:56.327310 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:56.364341 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:56.364821 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:56.365249 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:56.365687 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.objects.instance [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lazy-loading 'fault' on Instance uuid 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a {{(pid=121063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:33:56.406935 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:33:56.414771 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-f11e86c0-ddf9-4251-8c08-416ce8ec2c6f tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 200 len: 1230 microversion: 2.1 time: 0.101367 Sep 01 09:33:56.415403 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 591/1196] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:33:56 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:33:57.436773 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:33:57.438072 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:33:57.444579 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:57.445056 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:57.445486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:57.446163 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:33:57.446629 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:33:57.447032 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:33:57.460126 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] HTTP exception thrown: Instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a could not be found. Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Request method failure captured: Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a HTTP/1.1 Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHqhE0XT54Fzux_jBFIQx5-CCgpOFYa52J59mD6CPo-8D9PbCjnvcqoBm6hGjo1EGvHHVypYYKHwJtUrNc-FcOpkFbxvM8fFjq4c19chK5xDvmXt-NMa0XnKhoTzllNmts6lQYwgLWnQVmpkypbA9ayakdvH43Wv6AkpGYI7PaQFZ1g Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:33:57.461706 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94894dd3e80e424b8f34affb48a574ce", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94894dd3e80e424b8f34affb48a574ce"}]}] Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-TestVolumeBootPattern-617763892 Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 440380722a284fbe97aad70139e5ff1f Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a could not be found. Sep 01 09:33:57.463574 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '06a39d9f-21f4-4b41-b6a9-ce2c31fee22a'} Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a could not be found. Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:33:57.464612 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a could not be found. Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a could not be found. Sep 01 09:33:57.466359 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:33:57.468245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Returning 404 to user: Instance 06a39d9f-21f4-4b41-b6a9-ce2c31fee22a could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:33:57.468245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-0672a07b-ed2f-48d9-a5b5-89949159c3a0 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a" status: 404 len: 111 microversion: 2.1 time: 0.031047 Sep 01 09:33:57.468245 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 606/1197] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:33:57 2022] GET /compute/v2.1/servers/06a39d9f-21f4-4b41-b6a9-ce2c31fee22a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:34:00.818973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:00.819660 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:00.821839 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-b6ceb208-c5a1-41d6-9431-bf4b4f8164a2 req-156f7f1b-fbbc-4482-9c90-b1265f6ab50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2588862-ac08-41cf-8b3c-5b0bebc00c70", "tag": "ca786a5e-0b3c-4251-a210-43bfd78318ca"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:34:00.826035 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:00.826528 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:00.826973 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:00.828135 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:00.828276 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:00.828653 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:00.834453 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-b6ceb208-c5a1-41d6-9431-bf4b4f8164a2 req-156f7f1b-fbbc-4482-9c90-b1265f6ab50e service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:00.835031 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-b6ceb208-c5a1-41d6-9431-bf4b4f8164a2 req-156f7f1b-fbbc-4482-9c90-b1265f6ab50e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:00.836109 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-b6ceb208-c5a1-41d6-9431-bf4b4f8164a2 req-156f7f1b-fbbc-4482-9c90-b1265f6ab50e service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:00.847877 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-b6ceb208-c5a1-41d6-9431-bf4b4f8164a2 req-156f7f1b-fbbc-4482-9c90-b1265f6ab50e service nova] Creating event network-changed:ca786a5e-0b3c-4251-a210-43bfd78318ca for instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 on hv-cinder-82002 Sep 01 09:34:00.855588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-b6ceb208-c5a1-41d6-9431-bf4b4f8164a2 req-156f7f1b-fbbc-4482-9c90-b1265f6ab50e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037645 Sep 01 09:34:00.856390 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 607/1198] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:34:00.856966 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Going to try to terminate instance {{(pid=121063) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 09:34:01.153248 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-9f0ceb2f-6545-4728-9027-09dd55ef9c4c tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 204 len: 0 microversion: 2.1 time: 0.338585 Sep 01 09:34:01.153859 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 592/1199] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:34:00 2022] DELETE /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 09:34:01.162847 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:01.163588 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:01.170303 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:01.170803 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:01.171290 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:01.172009 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:01.172471 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:01.173609 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:01.310203 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:34:01.318765 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-55c4b59f-d9b0-4002-a615-fa20492d0390 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1578 microversion: 2.1 time: 0.160207 Sep 01 09:34:01.319363 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 608/1200] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:34:01 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:34:02.340535 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:02.341237 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:02.348121 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:02.348607 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:02.349049 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:02.349734 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:02.350187 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:02.350613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:02.506000 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:34:02.513852 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-2004dbdc-a1bc-4e2b-88d6-881d07441b62 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1578 microversion: 2.1 time: 0.177548 Sep 01 09:34:02.514420 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 593/1201] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:34:02 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:34:03.531733 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [req-13d8a581-30d4-4b60-8aff-758c127165a8 req-ae199321-916c-445d-9656-31d2665099b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2588862-ac08-41cf-8b3c-5b0bebc00c70", "name": "network-vif-deleted", "tag": "ca786a5e-0b3c-4251-a210-43bfd78318ca"}]} {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 09:34:03.535522 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:03.536710 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:03.542571 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:03.542809 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-13d8a581-30d4-4b60-8aff-758c127165a8 req-ae199321-916c-445d-9656-31d2665099b3 service nova] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:03.543053 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:03.543372 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-13d8a581-30d4-4b60-8aff-758c127165a8 req-ae199321-916c-445d-9656-31d2665099b3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:03.543499 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:03.543795 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [req-13d8a581-30d4-4b60-8aff-758c127165a8 req-ae199321-916c-445d-9656-31d2665099b3 service nova] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:03.544295 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:03.544751 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:03.545168 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:03.555681 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.compute.server_external_events [req-13d8a581-30d4-4b60-8aff-758c127165a8 req-ae199321-916c-445d-9656-31d2665099b3 service nova] Creating event network-vif-deleted:ca786a5e-0b3c-4251-a210-43bfd78318ca for instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 on hv-cinder-82002 Sep 01 09:34:03.561519 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [req-13d8a581-30d4-4b60-8aff-758c127165a8 req-ae199321-916c-445d-9656-31d2665099b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032783 Sep 01 09:34:03.561958 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 609/1202] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Sep 1 09:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 09:34:03.613163 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.policy [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121063) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:34:03.620948 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-d44908e2-223a-4ca2-b85b-4c29e32888fe tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1393 microversion: 2.1 time: 0.090033 Sep 01 09:34:03.621529 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 594/1203] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:34:03 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1393 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 09:34:04.643778 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:04.644474 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:04.650527 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:04.651008 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:04.651486 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:04.652177 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:04.652631 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:04.653086 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:04.684964 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:04.685469 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:04.685978 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:04.686424 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.objects.instance [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lazy-loading 'fault' on Instance uuid b2588862-ac08-41cf-8b3c-5b0bebc00c70 {{(pid=121062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 09:34:04.728452 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.policy [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440380722a284fbe97aad70139e5ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94894dd3e80e424b8f34affb48a574ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121062) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 09:34:04.736542 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-6b427a8f-4666-49fe-882d-3104236471f9 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 200 len: 1231 microversion: 2.1 time: 0.097205 Sep 01 09:34:04.737143 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 610/1204] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:34:04 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 09:34:05.758964 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:05.759712 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: b2588862-ac08-41cf-8b3c-5b0bebc00c70] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:05.766123 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:05.767143 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:05.767609 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:05.768290 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:05.768748 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:05.769205 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:05.783096 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] HTTP exception thrown: Instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 could not be found. Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Request method failure captured: Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 HTTP/1.1 Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHqhE0XT54Fzux_jBFIQx5-CCgpOFYa52J59mD6CPo-8D9PbCjnvcqoBm6hGjo1EGvHHVypYYKHwJtUrNc-FcOpkFbxvM8fFjq4c19chK5xDvmXt-NMa0XnKhoTzllNmts6lQYwgLWnQVmpkypbA9ayakdvH43Wv6AkpGYI7PaQFZ1g Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:34:05.784799 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94894dd3e80e424b8f34affb48a574ce", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94894dd3e80e424b8f34affb48a574ce"}]}] Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 440380722a284fbe97aad70139e5ff1f Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 could not be found. Sep 01 09:34:05.786700 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': 'b2588862-ac08-41cf-8b3c-5b0bebc00c70'} Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 could not be found. Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:34:05.787840 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 could not be found. Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 could not be found. Sep 01 09:34:05.789599 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:05.791257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Returning 404 to user: Instance b2588862-ac08-41cf-8b3c-5b0bebc00c70 could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:34:05.791257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-a9a6e7c5-8480-47ba-829c-888bb0561725 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70" status: 404 len: 111 microversion: 2.1 time: 0.031835 Sep 01 09:34:05.791257 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 595/1205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:34:05 2022] GET /compute/v2.1/servers/b2588862-ac08-41cf-8b3c-5b0bebc00c70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:34:06.323831 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:06.324358 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.compute.api [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121062) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:06.330981 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:06.333194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:06.333194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:06.333194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:06.333194 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:06.333611 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG oslo_concurrency.lockutils [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:06.347380 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.wsgi [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] HTTP exception thrown: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Request method failure captured: Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: request: DELETE /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f HTTP/1.1 Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept: application/json Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Accept-Encoding: identity Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Connection: close Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Length: 0 Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Content-Type: application/json Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Host: 10.222.0.46 Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: Openstack-System-Scope: None Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: User-Agent: python-urllib3/1.26.12 Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Auth-Token: gAAAAABjEHqhE0XT54Fzux_jBFIQx5-CCgpOFYa52J59mD6CPo-8D9PbCjnvcqoBm6hGjo1EGvHHVypYYKHwJtUrNc-FcOpkFbxvM8fFjq4c19chK5xDvmXt-NMa0XnKhoTzllNmts6lQYwgLWnQVmpkypbA9ayakdvH43Wv6AkpGYI7PaQFZ1g Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Id: None Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Domain-Name: None Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Identity-Status: Confirmed Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Is-Admin-Project: True Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Id: default Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Domain-Name: Default Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Project-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Role: reader,member Sep 01 09:34:06.349026 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Roles: reader,member Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94894dd3e80e424b8f34affb48a574ce", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94894dd3e80e424b8f34affb48a574ce"}]}] Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-Tenant-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Id: default Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Domain-Name: Default Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Id: 440380722a284fbe97aad70139e5ff1f Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: X-User-Name: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: method: > Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: exception: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.350777 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: action_args: {'id': '5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f'} Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:34:06.352184 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.353920 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.355598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Returning 404 to user: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. {{(pid=121062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:34:06.355598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-93ddc904-f55c-44e9-8178-d91dc2947776 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 404 len: 111 microversion: 2.1 time: 0.030671 Sep 01 09:34:06.355598 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 611/1206] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Sep 1 09:34:06 2022] DELETE /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 09:34:06.358985 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '>' {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:06.359661 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.compute.api [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] [instance: 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f] Fetching instance by UUID {{(pid=121063) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 09:34:06.366151 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:06.366641 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:06.367082 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:06.367832 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Acquiring lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 09:34:06.368300 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 09:34:06.368733 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG oslo_concurrency.lockutils [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Lock "0b35e4d9-fea5-4082-84bb-222d74bca9ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 09:34:06.383015 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.wsgi [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] HTTP exception thrown: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Request method failure captured: Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: request: GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f HTTP/1.1 Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept: application/json Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Accept-Encoding: identity Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Connection: close Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Length: 0 Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Content-Type: application/json Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Host: 10.222.0.46 Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: Openstack-System-Scope: None Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: User-Agent: python-urllib3/1.26.12 Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Auth-Token: gAAAAABjEHqhE0XT54Fzux_jBFIQx5-CCgpOFYa52J59mD6CPo-8D9PbCjnvcqoBm6hGjo1EGvHHVypYYKHwJtUrNc-FcOpkFbxvM8fFjq4c19chK5xDvmXt-NMa0XnKhoTzllNmts6lQYwgLWnQVmpkypbA9ayakdvH43Wv6AkpGYI7PaQFZ1g Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Id: None Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Domain-Name: None Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Identity-Status: Confirmed Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Is-Admin-Project: True Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Id: default Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Domain-Name: Default Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Project-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Role: reader,member Sep 01 09:34:06.384579 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Roles: reader,member Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94894dd3e80e424b8f34affb48a574ce", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94894dd3e80e424b8f34affb48a574ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94894dd3e80e424b8f34affb48a574ce"}]}] Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Id: 94894dd3e80e424b8f34affb48a574ce Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-Tenant-Name: tempest-TestVolumeBootPattern-617763892 Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Id: default Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Domain-Name: Default Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Id: 440380722a284fbe97aad70139e5ff1f Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: X-User-Name: tempest-TestVolumeBootPattern-617763892-project Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: method: > Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: exception: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.387158 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: action_args: {'id': '5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f'} Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: {{(pid=121063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 09:34:06.388292 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. Sep 01 09:34:06.390532 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: ERROR nova.api.openstack.wsgi Sep 01 09:34:06.392613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: DEBUG nova.api.openstack.wsgi [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Returning 404 to user: Instance 5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f could not be found. {{(pid=121063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 09:34:06.392613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: INFO nova.api.openstack.requestlog [None req-416c4fc3-6b82-48b7-a2f6-cf236171a6a1 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f" status: 404 len: 111 microversion: 2.1 time: 0.030875 Sep 01 09:34:06.392613 dv-cinder-820027-23-iscsi devstack@n-api.service[121063]: [pid: 121063|app: 0|req: 596/1207] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Sep 1 09:34:06 2022] GET /compute/v2.1/servers/5e10b272-c3b4-4916-8e2f-6a0e5ffbbc1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 09:34:07.843594 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: DEBUG nova.api.openstack.wsgi [None req-7842a610-50fc-47cf-a3d1-f2da1a6a5563 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] Calling method '.version_select at 0x7f7a656c5670>' {{(pid=121062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 09:34:07.914254 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: INFO nova.api.openstack.requestlog [None req-7842a610-50fc-47cf-a3d1-f2da1a6a5563 tempest-TestVolumeBootPattern-617763892 tempest-TestVolumeBootPattern-617763892-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1796876812" status: 202 len: 0 microversion: 2.1 time: 0.074375 Sep 01 09:34:07.914837 dv-cinder-820027-23-iscsi devstack@n-api.service[121062]: [pid: 121062|app: 0|req: 612/1208] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Sep 1 09:34:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1796876812 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)